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ABSTRACT 

Sixty-eight specific interventions to improve science 
education were grouped into 11 categories. Each category was then 
related to one of three major intervention objectives and an 
associated group. These categories, grouped by objectives are: (1) 
interventions increasing amount of time students are engaged in 
learning science (increasing student requirements); (2) interventions 
increasing quality of instruction (preservice education; enhancing 
teaching as a career; improving instructional practice; inservice 
education; improvement of materials, facilities, and equipment; and 
assistance from business and industry); (3) interventions to increase 
the "match" between actual classroom objectives with objectives most 
appropriate in today's world; and (4) facilitating interventions 
(improving local leadership, testing programs, and public education ) . 
Analyses were conducted to determine the cost of implementing each 
intervention arid to determine a rating of its effectiveness based on 
research data and other available information, fhe major conclusion 
reported is that solutions to problems in science education must be 
sought in the form of combinations of interventions with full regard 
for the interactions among these interventions. (Also included are 
modifications of analyses as they pertain to mathematics education 
and a delphi study on interventions for improving science arid 
mathematics education in Colorado.) (JN) 
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PREFACE 



This project »as born about a year ago in a '^"'"^^e of uncertaint), abotft ; 

tKe .nil ^^^^^"^^^i::;^^^^^:::^':^^^^ = "tt of 

' tfd n -th " JS^o^^c ^SeUtiJn^Uh oj^er countries 1ncreas,ng y wa. , 

Tf ?"e^?r?srue;?rra^^rcJruferus\.i^:cei^n. 

commissions about U.S. educatior,. ^ ^^ere should be a sharp; ' 

-rub55r:f rs t^n^f i;about 

■ rsfor^^pfe^seS a V ;fco tp the Sputn. era ,of^a. art. century 

ago when responses to s mi 1 ar concerns ^ere . a y Legislation is be,ing 

^'^^"r%"n;oaLe7 tas'for s'a Lfss^ors'are deliberating (often at 
considered and P^^^^^' , ^^^"^ • ^Jance is^ being offered to local school • 

the behest of governors), and assi stance is oer gu requirements. 

most bang for the buck, or for h t ma ter ^ r^^^^^ ^ ^,,11^ 

Fortunately, there are steps that can be ^J^^^n^" ( invo'lved and 'research 
analyze the situation based on ^^^f. °; 'ftfon to prod^^^^^ educational 
findings about potential sue es of var ou. c on^ t^o^^ 

''TV. aJalvs"'"' hf t u ^rthe analysis deserve considerable 

Explanation' in- and rf%hemsel3es . but for that information the reader is 



in detail for science and then add information on mathematics at several 
Darticularly key points. The report format that evolved from this process is 
?DDarent from reviewing the Table of Contents. Specifically, the ana ysis for • 
science education is in Part 1. The following section. Part 2 explains ways 
in which the project results can be safely extrapolated to mathematics and . 
Gases in which some different conclusions may- be appropriate because of the 
subiect specific aspect of the work. . . 

Finally it should be noted' that Part 3 is as much an appendix to the 
report as anything else. It reports the results of a Delphi study using a 
series of questionnaires sent to a group of leading educators in Colorado to 
qain- their judgments as to the effectiveness and feasibility of interventions 
for improving science and mathematics education and the appropriateness of 
various instructional goals for science and mathematics.. It is of interest, as 
a separate report and was used as a source of information for writing the 
■first two parts of this report. , f„ ' 

As a result of this report organization, some readers may choose to reaa^ 
only Part 1 and obtain the information of interest to them, i .e. ,. information 
about science education. The person interested ifi mathematics education wi 1 I 
need to read both Parts 1 and 2 to receive the full scope of the "Report. 
Still other readers may have suffici^ent interest in. the results of the Delphi 
study that they would choose to read Part 3 as well. 

As with most projects of this scope, it was the work of more than one 
person and the various roles s.hould be acknowledged here. First ot all, 
.Cynthia UeLarber has played a key role. A staff member of the Colorado _ 
Department of Education, she has served as a liaison with that agency. (The 
Department has provided the majority of the project's rmancia support; the^ 
remainder of the :support came from the University of Colorado.) Her role has 
been more than a liaison, however, in. that she has been involved in the actual 
nroiect work. As, a policy analyst, she was wel L prepared to obtain needed^ 
information from a variety of soWces. In addition, she played the Key^role 
in obtaining and analyzing information acquired via the Delphi study. .Her 
"or has been-handTed'wit? competence and dispatch. .WiV^F I'lTgsl nd'Iiaf 
as a graduate research assistant on this Project, during the Fal 1 1983. and was 
particularly instrumental in collecting and processing the information for the 
cost analyses used in this report. ^ • „f nin^ 

Additional participants in the project were an advisory group of nine 
neople who met on three occasions to provide advice, react to the conceptual^ 
framework developed, up to that point, provide many important suggestions as to 
how the work should proceed, and react to the written materials which emerged 
from the project. -This group .included David Armstrong, Director or the Center 
for Interdisciplinary Studies; .David Hill, Chairman of the Geography 
Deoartment: George Maler, Associate Dean of the College of Engineering; and 
WeslerYordan Chairman of the Economics Department, all from the University 
of Colorado; Roscoe Dav idson , Superintendent of the Englewood schools; Norns 
■Harms, Educational Consultant; Charles McNerney, of the Departmantof ,. 
Mathematics at the University of Northern Colorado;- Eric Mi ler, 3^"^°'^ Jigh 
school science tekher with the Boulder Valley Public Schools; and Harold . 
Pratt, Science Supervisor of 'the Jefferson County schools Al.l these^people 
• madP moortant contributions, but additional note should" be taken of the .■ 
coJtribSt^ohs of two people ^ho did work beyond the specific group meetings'. 
Norris Harms helped to conceptualize the results of ^he (irst_stage ot _ 
questionnaires in the Delphi study, and Wesley . Yordan helped identify the type 
of economic analysis needed for the project. • , • • . 



Since the^overall design of the project the -J^f ^^^^Sf/^rn^oJlhe'' 
writing of the entire report were '^^"J^^ij^Ste for what is presented in 
^^^"'^^^^ w-^ lirand'l 9" ficant, hut the first 
aulhorTusJ'tare responsibility for the final product. , 



Ronald D. Anderson 
•January 1984 
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The education of American students in science and mathematics today is 
inadequate; numerous reports have documented that students are not • 
sufficiently well prepared for living in an increasingly scientific and 
techno ogical world. As with other complex public .issues, a careful cost- 
effeaiveness analysis ,potenti ally can identify promising solutions for the 
"crisis" in science and mathematics education. 

The process employed involved an assessment of both the cost and 
effectiveness of dozens of actions or interventions proposed as solutions. 
Early steps included identifying the objectives of the actions, the 
alternative interventions, and measures of their effectiveness. Once 
estimates of cost and effectiveness had been made, models relating costs and 
effectiveness were developed and recommendations prepared. In the process 
competing value judgments were recognized and, taken into account. 

The Process ■ • 

The first step in the process moved beyond the varying definitions of the 
"Droblem" by formulating a set of objectives encompassing the many ■ , 

interventions under consideration. Three objectives were selected as , 
representative of the intent of the many proposed interventions receiving ^ 
public attention today. 

a. Quantit y. •Increase the amount of time in which students .are engaged 

in learn ing science. . . , 

b Qualitv, increase the quality of instruction in. science classes, 
e*. AHWri ateness . Increase the "match" between actual classroom 
. objectives and those objectives most appropriate in today's world. 

The interventions proposed in various quarters for improving science 
education are numerous.. For purposes of this analysis, they -were 9^°^?^^ ^"^^ 
eleven categories and each of the eleven, categories was attached either to the 
one of the three above objectives it most closely fit or it was associated _ 
with a fourth grouping, labeled as facilitating interventions; i.e., categories,:; 
of interventions that, though not necessarily promoting directly the , 
. atti nment of any of these objectives, potentially are of benefit in .changing , 
some aspect of schooling that in turn will foster attainment of one or more of 
these objectives. The eleven categories'of interventions, grouped by 
objectives, are presented below. " j 

A. .Interventions primarily related to Objective #1: Quantity J 
1. Increasing student requirements 
. . B. interventions' primarily related to Objective #2: Quality__ 
1. Preservice preparation of teachers 
• 2. Enhancing/teaching as a career 
' 3. Improving instructional practice 
• 4. Inservice education 
5. Improving materials, facilities and equipment.. 
6*. Assistance from business and industry 



' C. Interventions primarllV relatec^ to Objective #3: Appropriateness 
1. Improving school curricula 
0. Facilitating Interventions 

1. Improving, local leadership 

2. Testing programs 

3. Public education 

• * ■ 

Listed within these eleven categories were sixty-eight specific 
interventions. For example, the increasing student requirements category 
included such specific interventions as increasing graduation requirements, 
lengthening the school year, increasing homework, and increasing the 
proportion o' class time devoted to instruction. An analysis was done to 
estimate the jost of implementing each one and to determine a rating of itr, 
effectiveness based on research data and such other information as was 
available. As single interventions, few gave much promise of being both low 
in cost and high in effectiveness. 



Conclusions 

The major conclusion of this analysis is that it is pointless to seek 
solutions; to the problems, of science education in the form of single 
interventions. The situation is systemic ; solutions must be sought in the. 
form of; combinations of interventions' with full regard for the interactions 
among these jnterventions. . For example, inservice education for teachers has 
little potential as a-single intervention, yet it probably is a critical 
componenti of a combination of interventions intended to produce most changes 
in the classroom. In combination with such other a'ctions as curriculum 
development and effective leadership from principals, there may be substantial 
potential^ for educational improvement. The removal of a critical element from 
this endeavor (i.e., inservice education), however, may negate the effect of 
the total set of actions. An action which by itself may have minimal effect 
may, by its absence in another setting, result in a minimal positive effect 
from otheir interventions. . . ^ 

Dealing with these' combinations of interventions and their interactions 
requires a conceptual framework that relates the interventions. This 
structure was acquired from the research on effective schools, implementing . 
educational change and the leadership of principals. The impl ications . of this 
research are that (1) combinations of interventions are necessary, (2) the 
completeness of this combination may be critical, i.e., the absence of one 
particular intervention may seriously impair the effect of the package of 
several interventions, and (3) a multi-level approach is needed, i.e., some 
actions should be taken at the building level, some at the district level, 
some "at the state level, and some at the federal level. Further implications 
°of this research are that all change endeavors should be coordinated, and 
focused upon the local level where possible. A multi-level approach /enquires 
state and; federal actions, but all action at.these levels should be taken with 
full recognition of the importance of local "ownership" and commitment. . 



A State Plan 

The core of the recommendations Is. a state plan of action Intended to 
foster local initiative and draw federal assistance into a concerted state 
endellortw 1 require strong leadership at this level. Among the 
Too" nated e? of state-level iSfervention^" constltut ng th s program are to: 

--provide funding and professional assistance to local leadership, 
and sclence^ education improvement programs 

—fund improved teacher education programs , . a ^ ,««nf 

-provide training for local district personnel on curriculum development 

and implementation, . , ^ i 4. 

-fund multi-district consortia for curriculum development 
-provide information for local school board members on needed 

improvements in science education , „^i,f« 

-provide conferences for local district testing personnel on appropriate 

science tests ^, ■, ■ ^.i r 

-establish a -science test item bank with items on the applications ot 

--provide awareness conferences and other information for local account- 
ability committees concerning science, education improvement 

—establish leadership for the above interventions which will enable them 
to proceed in a coordinated manner with appropriate modifications as 
indicated by evaluation and communication with local education ■ 

■ personnel. 

LocaV Action 

The basic intent of these coordinated ,interventions is to stimulate Jocal 
initiative in a systematic manner which promotes the quantity, quality, and 
appropriateness objectives. Local' leaders will be encouraged to pursue a 
systemic approach including attention to several means of achieving each 
objective. . ' 

Quantity 

--increase graduation requirements in science 

—increase homework (coordinated with classwork) ' 

-help teachers in more fully utilizing instructional time 

Quality '\ " ■ . 

--foster teacher recognition and professional devel^opment, and an 

improved professional environment ^ * 
—improve teacher recruitment and selection 
.-provide increased supervision and assistance focused upon the 

improvement of instruction 
—introduce improved instructional practices , . ^ 

—conduct inservice education which supports the other interventions . 
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--support local science curriculum development 



Facll Itati on 

--Initiate Improved program evaluation and programs of science education 

improvement ^ • • i 

--initiate careful selection and preparation of principals and 

supervisors. 
Federal Action 

Federal action should be sought which fosters the local and state, 
endeavbrs described above. Specifically Included are the following actions, 
--provide Inservice and summer teacher institutes that are tied to and 

supportive of local district improvement endeavors 
--support curriculum development projects with particular emphasis on the 

application of science knowledge . , r ^.u • 

-fund consortia of school districts for developing curricula for their 

— fund^research to increase the knowledge base needed for appropriate 
curricula, analysis of science education problems, and identification 
of actions needed for improvement j r 

—provide an awareness conference for test publishers on the need for 
items emphasizing the applications of science knowledge 

—provide funding to sustain state programs as described above. 



A Systemic Approach . ' 

The proposed state plan is a coordinated response to a systemic problem; 
the°basic intent is to foster local initiative utilizing all resources 
available, including federal funds. Each intervention in the total plan 
contributes to an overall approach; an intervention or two selected from each 
level of this listing and implemented in the absence of the. others does not- 
hold much promise of a significant impact. 



Mathematics 



The analysis and recommendations for mathematics are quite similar to 
those presented above for science with the exception of those pertaining to 
the appropriateness objective-. The question of what mathematics is most 
appropriate, for students to learn is a different question from the analogous 
question for science. 



PART I. A COST-EFFECTIVENESS ANALYSIS OF INTERVENl lUINb 
FOR IMHROVING SCIENCE EDUCATION 



Chapter 1. Cost-Effectiveness Analysis ; , 
An Aid to Policy Decisions 

The specific technique employed in this endeavor is cost-effectiveness 
analysis. Before simply describing Its application to the problem at hand, it 
may be well to examine briefly the process J^self; what is it. and what are 
Its advantages and limitations? With this background, it then will be 
possible In the remainder of this chapter to examine more fully the 
relationship between decision-making in the political realm and policy 
analysis using a variety of techniques sometimes referred to as "rational 
techniques" by students of policy analysis (Carley, p. 3). , 

Defined broadly, cost-effectiveness analysis is "any analytic study 
designed to assist a decision-maker in Identifying a preferred choice among 
possible alternatives."^ More narrowly defined, it involves 'a compar son of 
Alternative courses of action in termsgOf their costs and their effectiveness, 
in attaining some specific objective." ^ ■ v4«n «f /.«ct 

Cost-effectiveness analysis sometimes is considered a variation of cost- 
benefit analysis, an approach which analyzes alternative actions in terms of 
cost and benefit;, both measured in dollar terms. Cost-effectiveness analysis 
measures costs in dollar terms but evaluates outcomes in other units. i^ost- 
effectiveness analysis tries to show how a given level of benefit can be 
achieved at a minimum cost, or to show how the maximum benefit can be achieved 
at some given level of cost. The keynote of both of these Problems, is that it 
is not necessary to attach any explicit money value to^benef its. ^ The 
methodology cannot be prescribed as a precise set of standard procedures but 
must bt viewed as a general approach with a sequence of general steps. They 
include: 

"1. Definition of objectives 

2. Identification of alternatives 

3. Selection of effectiveness measures 

4. Development of cost estimates 

5. Selection of a decision criterion 4 

6. Creation of models relating cost and effectiveness. 

Other analysts such as Quade describe the process in similar terms although 
the number of steps and their sequence may vary slightly.- 



Objectives 

The definition of objectives is a particularly crucial starting point 
since the remaining steps are built upon the particular objective specified. 
Stated improperly, the objectives car) produce an analysis that misses the 
intended target. In the case of the- project at hand,, this step is 
particularly important since the objectives were not specifried in precise 
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f^v^m^ And nrnvidPd to the analyst in advance as givens. Instead reference 

: fA Sr In'ratSer genera ter™s to the. problems faced ij^-.^|jce f 
mathematics education today and an expressed desire to find cost-etTective 
s?epsfoJ bringing about improvement and thus alleviating the problems. 

Alternative Actions 

Identification of"" alternative actions was a relatively easy step for this 
nroiea in tha? arge numbers of them have been advocated and widely reported, 
in the pipu ar and professional literature. While objectives have ot been 
stated precisely, numerous alternative interven ions, have been wdey 
aHunratPd A keV step in this project was developing a . list or sucn 
fnterfentlons a'representative list, though not exhaustive) and organizing 
ihem'in some manner that would make them amenable to cost-effectiveness 
.analysis.i : ^ / c 

; ■ • ^ 

Effectiveness Measures 

Widely publicised problem statements, ' as. wel 1 as the specif ic objectives 
imolied by proposed interventions, point 'to a variety of effectiveness 
Sslres'^.S^re ?or many projects a single effectiveness ^^easure ^ay 
appropriate, in this endeavor a total of ^^ree distinctly different ones were 
pmoloved. They relate to (1) time engaged in learning, (2) ^5"Jent learning 
a^mSed by tests, and (3) changes in curriculum goals. Although not , 
mutralli exclL-ive. these three effectiveness measures by.-and-l arge deal w th 
different objectives and different intended changes in sc.ence and mathematics 
eduSiSn. The rationale for choosing thes. three is developed later in the 
report. 

Cost' Estimate's , . 

A variety of costs must be taken intoraccount in estimating the price of 
a narticSlar intervention. Some costs are direct and others are opportu^ ty^ 
• ?osts some costs are borne by the taxpayer, some by teachers and st 11 others 
bv studpSts In generar, reasonably' good estimates^ of these costs- can be 
obtained Specific mean^ by which they. are calculated and summarized to 
provide ; final cost estimate for a particular, intervention are described in 



Chapter 3. 
A Decision Criterion 



"Three types of valid criterion from which the analystmust choose are: • 
I) maximize effectiveness at a given cost; 2) rinimize cost win le attaining a, 
i ven effecti venes or 3) sojie combination of ti.ese two which ^recognizes a 
tJa^eo^rof tost effectiveness to maximize a selected, utility function of 
Jlie two factors ."^ The latter approach was chosen in. this study,; the 
complexity of the situation dictated this choice. 



Creation of Models 



Having co.p.leted the above, steps, ^^ll^/^^jJl^^/.^^.nrve^essranilhe 
identi?yin analytical f^^?"^ IP^^.r^o^e tiate tlsk was 

context in whichithe. mterventions ,a^^^ because the analysis indicated ear-ly 
particularly difficult in ^^is project Decause ^^^^^ ^ould not be 

that the long list of single ^"^^'^^^^^l^J' is highly systemic and some 
treated as single interventions. The situa.i^^^ ^^^^^^ 

5°ft:?c11°L°v^nr"w^drrge^Src^ . 



var i at ions . 



Having described the essence of th>^^^^ 
methodolt)gy as it pertains ^J^^^^ %pro pet it is wen 
briefly to some of Jhe advantages and J^^^f identifying those 
obvious advantage of the^technique s its P°f^"^^^2' ^^uce effects worthy of 
interventions which can be done fJ"^^J ^^^i p'SJess is such that it tends to 
the expenditure. The nature of J5'%P°Jl^^',sP;°th insufficient attention to" 
focus on the .direct expenditu^^^ ,he more 

opportunity costs JJ^ J Weniss analysis focuses attention upon all 

objective process of "^t-ef fectiveness^ ^^^^ to effectiveness probably 

costs.. The. advantages of this analys s wun re ^lons about the 

are even greater; ^he usua tendency is ^^JJ^^.tioS seems to have its 

effectiveness of P'"Of ^^d interventi.ons tacn ^^^^ particular 

advocates and the nature of JJe political process ^^^.^ 

-r-c^r ract^rr/arhe^jr^^ ° i nru robi^c ife ^ ^fro^' 

effectiveness of . a P^^-ticular interventio^^^ technique is its clarification of : 
A second major advantage specif ication of causal 

. the value judgments involved 'Th^^^/JPji Jg^^^^^^ which all parties to a 
relationships can also help to expose value ju g . ^^^^ judgment or 

decision bring to that decision ..(Carley.P^ and value neutrality 
ideology within rational techniques is inevUaDie^a^ expected and made 

impossible. . . . ^^^%"f"'^naly fs" (iarlerr'l). Value judgments ara 
as explicit as possible, in the fjjy^ .^./^^a ys s. This prominence is 
numerous and prominent v-n this particular analy^^^ ^.^^ ^^^^.^^ 

illustrated by the ^J^^^ f °"%choo s ^he pervasiveness of value judgments 
the goals of. instruction ^MJ^ "hoo s. ^^^^ Pe questionnaires given, 

was highlighted even rjone by resu Us of a se ^^^^^^^ analysis. 

• ^Se'rerufts S red'sfi r thft th^r^ aJ't^o^rather distinct camps in bur 
i triith -fpect to^i;e goals Of .science e uca ion 
As valuable as this process of analysis is U nas i imi.tations 

First, any analysis, is "f^ssarily ncomplete Ther^^ ^.^^ ^^^^^^^^ 

of time and money, ^"^dd tion one must jecognize ^ ,pon the 

resources there is "^^^^^ ° , IJ, ble and tS^^^ is'th'at the analyst 

situation. Too -^^"y i^damen^^ the decision-maker who 
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.:.,„„rf th<. process of cost estimation is not as precise as it may appear 
on the rf^c " 0 unate?y, the preparation of cost estimates remains for 

B ZTl^-^fT'^ estimate, 

r' !^i?.bi ?; an ?e a 1 y of data are always variable. In sun,, the 
I!;^v"d;lf sJln. experUnce. a^^„natural resourcefulness of the cost analyst 

''"''■1h?rd''measirerif'effectiveness necessarily are incomplete. Q^jde notes 

-r^f f>ei; :raoS2rc^s?%ftirt:i^-^'i r^^^{£^^- 

Measures of "J'' Ht'^"^' ^"^Hety of such measures ha»e been used in 

tS rsru 'a r "e^teS Z^^t^ considerable confidence, but one 

^ hk^:^^" 7^^^'^ l^ollirsnctory way to 
■ f future evenis in our society or educational system. Future events 

lav at r con tn which were' assumed for this analysis While not as 
b?g a probl|5 as some- of the other limitations noted above, U must be . 

''"^Sl'viSq defined the process of cost-effectiveness analysis and noted some 

S d 

1 . ^wfo iill^sl^u-to^some decree or -^^.l^l^'^^l^^i, of 

i^licv afa vsis is to enlighten the poHcy process from its particular 

c?"e ihiJh °s not 'expected to.be ""Pl^'^'^^^^^^^^^l^f^^^^ „„ 
enlinhtPnment may take the form of espousing one expl ici t we tare runction 

rdVterminin/the cost and effectiveness J J-ious a ternative^ ^^^^^^ 

?i?;£?ttrSrfcajr 
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re. 



Chapter 2. Analysis of Science Education 
Interventions: Conceptual Framework 

With the previous description of the cost-effectiveness pfocess as- a 
basi^- attention can be turned to the conceptual framework f J. this particular 
ana ;^s of the cost-effectiveness of interventions for improving science 
edScat on The interventions under consideration inclu^m/st of the major 
a?tio^s proposed by various commissions, task forces, cMtees and political 

^"'Tc:st^e?fec1ive:esr:n:iysis of alternative.meay/ reaching some 
objective requires that one knpw what that object ive/ff/ Such a statemenj 
seems obvious, yet identification.of objectives is ni Wof ten over loo^e^^^^ 
one may ca?e to admit. In reflecting on today's polU/ca rhetoric about 
education as well as commission and committee report/, it is easy to recall 
U k aJout cosU. Each presidential candidate is proposing so many hundreds 
nf millions of new dollars for certain activities to improve education. Yet 
2aref 3e ineaJion of what changes can be expected a's a |;«ult ..is quite rkr 
umav seem at times that the "throw money at the, problem" approach is being 
iseHifh L expectation that something good will.rSsult. The objectives 

^^'^'u ^Iso'sESSl'ie 'SJ"?hat it is possible to do the cost Portion of a 
cost-effect?veness anal, . - without well defined object ivesrFut it^wou d n^t 
hfl'^hle to do the effectiveness analysis without well defined objectives 
We Sot only mn.t knnw wli - at the prob lem is that is being addressed but we must 
knol what results are being sougHTTo-bring about some so "tion to the 
nrSblem TTHf^tice, the processes of defining the problem and identifying 
tSe object ve° probab y benefit somewhat from being done simu taneously. . 
AUh one ma? start'by defining a Problem, specifica y delinea ng e 
desired results or objectives helps to more precisely define ^^at the problem 
aesirea reb J of objectives for interventions intended to 

Improve science educa'tionfone must consider whether, these desired results are 

"^"'irt:r'°ca?rfurct?i2er:??on, three objectives were selected as representa- 
tive of the intent of the many interventions which have been proposed to - 
improve science education. They are as of ol lows. 

Qu^tity : Increase the amount of time in which studen.ts are engaged 

c in learning science. ' Y,oror 

Quality: Increase the quality of instruction in science classes. 
ADDrop? i ateness : Increase the "match" between actual classroom 
- objectives ancf those objectives most appropriate rn today's world. 

Before examining these objectives one by one, note that they are all expressed^ 
in terms of instruction rather than learning . This was a deliber.jte choice 
reached afte- r"much cons ideration. One might argue that the. objectives shou ,d 
Srexpre'ssed in terms of student learning since that ultimately is our^goal- 
to in?^eale student learning. But for purposes of this. cost-effectiveness 
ana ysi! Us better to use objectives expressed in terms of instruct on/ 
hSraise the connection between the intervention and these instructional / . 
outcomes ds Tre Sirect and 'there is a better basis for conducting an analysis 
that wi 1 shS relative costs and effects. The ultimate concern about - 



a. 

b. 
c. 
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learninq is important, however, and. cannot be ignored. So one shoulo 

rlnlVdlr carefully instructional goals, of the schools and be sure that they 

are ruly "he'o es Jesired, based'on what is known about the relationships 

•brtwee^nstruction and learning. They can' be examined one by one. ■ 
between instructio ^^^^^^^^ ^^^^ ^^^^ 

research shows a very direct relationship between the amo^of time devoted _ 
Jflear^ ra.d thelrtiount of learning that takes place. The rrequently cited 
"?imrnn t^<k''' research as well as findings embedded in numerous other 
re ra;^rh sfudie^ po^nU to This conclusion. This research base, one that 
goe Second c n??onal wisdo,n., is importar-t^because ^t/j;;'" ^^^f, ^ ^-^^f 
tSat additional time spent learning will be effective ^^"^ that ^^'P^^f 
diminishing returns" is not likely to be reached in our typical school 
sen qs So! it is wit— onsiderable confidence that we set one of the 
inftructional- objectives as increased time engaged in. learning with the : 
oynprtatinn that it Will result in greater learning. A . • 

^Se seco f objective^TuTcreasing the quality of instruction is more^- . . 
difficult to define and niore difficult to demonstrate as having_an ■j^JPact 
Iparnina but it appears " nonetheless, to, be important. Calls for increasea 

7of auJati'on generally, refer to. increased teacher compe ence in erms 
of knowledqe of science, skill in teaching, or dedication to the job. Only 
occasionally does increased quality refer to better facil ities, equipment and 
m^Jfr^u <;inrp this. matter of quality includes so many dimensions, it is 
" ' ble' 0 make a s?m le demonstrable 1 in^. ^^^ween qual ity^of instruc ion 
Inri IParnina There is evidence for a link between learning and some of these 
TndiiaJor of qualUy but that issue is the heart 6f the cost-effectiveness 
Ina ysis tself Man; of the interventions which have been proposed for _ 
imorrv nq science education are fooised upon wh^.t has been labeled here as 
auar?ty n this analysis, each intervention is examined individually as to 
its potential impact on student learning based on the research information, 

^'^'^The^third objective of appropriateness deals with the question of what 
u li h IInnh?thP science tauqht should be that portion most appropriate 

rf?^ect^vefe^^ Talfsll ^1^1^^^^ aft^ent^Sn mJstC ^ot^S S^Sft 
miart brtfrmed Jafue cWfirrcatio^ i.e.. determining the basis of various 
value iudqments about what knowledge is of most worth and sortrtig out the 
erioneous'assump?ions^and inaccurate pieces of conventional wisdorn so one can 

'''^'itlrJe'hefp^Iir'to-examine briefly some examples of competing value , 
posit ns' Some people would argue that the science taugh s ou d be whatever 
is most representative of the. particul ar science- di scipl ne under 
rnn^ideration- the expected student outcome is an understanding of the 
stJuctu^e of ihe discipline, its. major principles and concepts, and' some of 
the details needed to underhand the "big picture." Scientific ^dge 

1. .hiriL i^rown sake Others would argue that the science... taught should 
be Sa w h mo t fm ortant%or ,meeting'the personaV needs of studen s 
R?nlnnv fn^ example should emphasize the knowledge- which is of most help in 
SJSlrsUndinq ^he human^^^^^ and making decisions about personal ■ heal th, - 
: Sutrulon aJ'd The p^eventio^ of diseasl^^ With this focus, instruction on . 
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decision .aUn, and -ing biological .no^ Z^ti^^^'^^ ^^ 

be taught directly f Pf ^ of arectest value in addressing societal , 

emphasize .that !^"0«1edge wh c. is or gre aes, 

issues such as, energy world '0°^ supplies, ^"e e v ' ^^.^g^ce 

national secarity. and health among ^^J^^^L nro^eed further to learn how this 
knowledge needed to address ^^esesbues and proceed furtne o 

J?;inra"on;!'l!e!: attention to academic prep^ 

societaMssues, and so on. f ^^''^.^'''^i'' "'ther A Thorough analysis must 
''unt' r"th ' ari 'a^t n ^ph s 'and combinations of ?he.. ; 

*^'' 5 " t° h 'thJIe . b ec'iifes^ave been ■'escribed attention can e ^ • 

and expected effect of each ;ff«7'^°;>','J''J''e?;ec information with 
for each intervention there IS a P f"^ "^Jf'^J^f ,^terventions, however, 
respect to all ' o jectives In the case of^ Objectives: mjs't often 

^ fJoX^eslSSalvf'schoT systems !f,-aV or state agencies or . 

'""7anr:f?ecutesf 'irf":rtiorg:n;rall, is .or. "^fficult to obta;n 
The b:t{'so:"f is' etl designed experi.enta, st^ 

-ircriifhortrfntorff^^ 

l^S-, ^^^^^ SrtV^S?^v°a^r"to ?he effect o;-; a 

^""^n'tJiU ff^anTh^se efforts, however, 9aps>ilV remain for which no 
e.piricarda?a.are mailable In these cases e^a a t .sJeft__ V^^ - 

?Pr°anTecfsU:ra^;uttJ^ ff J v^^^ 

eliminating some potential interventions as so lacKing in m ^ 
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Objectives 



Interventions 



Quantity 



Quality 



Appropriateness 



Cost Effect 



Cost 



Effect Cost Effect 



1. 
2. 
3. 
4. 
5. 
6. 
7. 
8. 
9. 
.10. 
11. 

0 

12. 

13. 

14- 
15. 
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Fiou're 1 ■""'objectives-Intervention Matrix for Cost-Effectiveness 
ngure ^^^^^^^^^ Alternative Actions for Improving 

Colorado Science Education. 
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unworthy of a careful test, while other interventions may be identified as 
havina suffitient promvie to be worthy of such tests. 

Havino described the cost-effectiveness process in broad outline, 
atten? on ?an be urned to the set of interventions being considered in this 
^nalv^ir The number of possible interventions is large, a fact that 
ev? en to a yone familia? with, even a few of the many recent corr^ms on 
reports propLd pieces of legislation, and political statements In this 
n^^ea^n attempt has been Hiade to be incluf,ive, considering as many 
incerSentions as possible, yet limiting the endeavor enough to make^it 
ma^Sle This approach has been pursued by grouping the Possible , 
inte?ven ions n 0 b?oad groups, eleven in number,, and inc uding within each 
gr/up at least the major possible interventions. I" f^^,"^;'^^^^^, 
nte'rventions included for analysis i_nc ude essan a y ^ h m oo 



;,lnna with' examples of spec fic interventions m eaun v-au^y^. j. v . . v. ■•-"t- , 
and leUer cSnation used to label each of the eleven categories is derived 
from a^organifrtional pattern imposed in the next chapter, but is included 
here.to make cross-referencing easier.) 

A 1 Increased Student Re quirements . Improving the amount of itudent , 
earning in science " i^iTmHiiatics through such means ^s: 
' a! increasing the graduation requirements in science and mathematics 

b In'crellino^'cone^ admission requirements in science and mathematics 

for all incoming freshman, students. ^ 
c. increasing the length of tMe school day or the school year, 
d increasing the amount of homework, ! ^ . j a 

. .. e! iSc^easing the proportion of total class time that is devoted to 

" f. fScreaslnrthe' proportion of scheduled school days actually demoted 

^g. increfsing'the^cademic requirements ^grades) for student 
participation .in-a1rh->et-i-csT- 

B i o..co.wirp Prpparation of Teachers . Improving the preparation of neV* 
science and malhematics teachers L hrough such means as: 

new standards for preparation programs, ^>u„«i 
Create? science and mathematics requirements for elementary schoal 

specialized preparation programs for science and mathematics 
teachers in grades 4-6, _ . • • 

d. -"-'•^"'^ Pmnha^izina the applications of science and 

e mo^e^''hands-oh" work as part of teacher education "programs, , ' 
f* nlacina student teachers only with outstanding teachers, , 
a' • stronger enforcement of the requirements that districts hire only 
fully credentialed teachers (not hired on emergency certificates). 



a. 

fa- 
teachers. 



h.. ?oans or scholarships for persons preparing to be science or 
mathematics teachers. 



B.2. En»>ancinq Teaching as a Career . Enhancing teaching as a career through 

such means as: ; • i-, r- 

a. increasing the salaries of teachers in all fields, ^ 

b. increasing the salaries of teachers in science and mathematics to be 
competitive with alternative employment, 

c estatyVishing performance pay for teachers, . 

d. providing an improved professional environment within school 

districts, . ° ' - . • 4. u . 

6 developing other incentives for attracting and retaining teachers, 
^' f\ initiating campaigns to enhance local teacher recognition and 

respect, ' . 

q improving teacher recruitment and placement services, 
• h . involving teachers with researchers in collaborative educational 

. i. more emphasis on professional growth, including better supervision '. 
and evaluation- of teachers, and . 
j. reducing work loads, i.e., fewer sludents per class and fewer 
classes" per; day. ' . 

B.3. Im provued Instructlional Practices . Improvi1i.g instruction through such 

means as: \ . . ■ , 

a. improved stud'ent-teacher ratios, 

b. mastery learning, and ' 

c. computer-assisted instruction. 

B.4. . Iriservice Education of Teachers . Improving the inservice education of 
teachers through such means as:" ' , . ^ ^ ^^ ^ \. 

a. sunroer institutes for tscience and mathematics teachers at all levels. 
' •' ' (with federal or state funds), - , ' ■ .... 4.- 

b. academic year, full-time institutes for science ancj mathematics 
teachers (with federal or state funds), , 

c. "institute classes" in late afternoon and evenings during the school 
year (with federal or state funds), . . 

d. inservice education courses on the appl ications. of science and 
mathematics, ' . . . ' , 

» e. inservice education classes on higher level aspects of„ sc.ience and 

mathematics, , . 

f. inservice education courses^on teaching m;.<:hods, - , -lu 

g. inservice education programs coordinated with local endeavors (with 
federal or'' state funds), ; 

h. teacher centers where teachers can work together on program 
development as well as inservice education, " ■ ' 

i extended year contracts for teachers for program development work,, 
j! improved teacher evaluation. as a basis for professional growth and 

inseiirvice education, and 
k. sabbatical leaves for professionalgrowth. ' 

8 5' Tmnrnvi na Materials. Facilities and Equipment . Improving the qual ity of 
, * ' science teaching by providing more and better materials, facilities and 



equipment through such means as: 
a state or federal , funding of local district needs, and 
b; local district increases in budgets for materia-ls,. facilities and 
equipment. ■ . 
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B.6. 



T A c^.i^M flccictance Ifflorovinq science and mathematics education 
K r ^^t o"^^°f aLista ce.fro. business and. industry such as, 
nrnuiHinn ^eed money for- educational projects, 
Srov d nq afh awards for individually determined programs of . 
Sersona^^nd professional development which are sponsored by and 
named for particular industries, 



a. 
b. 



donating equipment', ■ . ,-u„„ic 

d loanina lecturers or workshop leaders to schools 

Sing employees into classroom teaching for a time. 



c. 
d. 
e. 



; rndrs?H:r iSt^rnli^pl^for teachers for 2 months in 

h. hiH^g^ra^hers as part-time (e.^ 
C.i. T.p.n.inc | School curriculum .^ Improving the school curriculum' through 

a deve Sptng morel courses^ showing the applications of science and . 

mathematics for| personal uses P^?? f^'^.^es for college- 

b. developing morej-rigorous science and .mathematics courses tor coiit^gt; 

bound seniors, ' , . , , . 

r reducing the number of "frill" courses, r 
d' federal funding: of new curriculum development projects, 
e! revir'ng the "ohd"^NSF science courses by expanding or replacing 

portions w.ith ibcat materials, . . mpcider (by 

f developing modeil curriculum patterns for districts to consiaer ^oy 

fl^or^i nr state aaencies or professional associations), , 

g p'/ovidin^ra.f^^^^^^^ 

rvei:?lrregi'onal consortia of schools and universities to .develop^ 

. i. s?7tes"or''groups of states setting new standards for the textbooks 
to 'be adopted, and - ^ 
j. improving program evaluation. 

T;;;n T;; lina Local Leadership . Wo,^4 VY^'^^^'^'^^'^^'^'^^ 

f^l^^^^ supervisors within. 

b weigitrnO^ogrlmTe'v^iopment more heavi ly.i^ the- job descriptions. 

nf district science and mathematics supervisors, • 
c Slig t ng sc enceand mathematics program developmen more heavily . 

i^n'the iob descriptions of general curriculum personnel, and 
d/ Ttate or federavLding of local district plans for providing 
greater leadership. \ 

rSS^}rreSj;r»%'?niS 4* preparation for d,str,ct. 

, J:-l„S!^rranJst avana.. 
for local school district personnel to draw upon., and 
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• * «4nn actahi:shed citizen-accountabnity groups of the need for 
tMsTp ove Is ng and encouraging them to use their influence to 
aSrure that appropriate modifications in tests are made. 

Pnhlir Education. Generating greater public understanding and support 
^ 7 Klg science i nd mathematics education through suc.v means a : 
° Various media advertising to .promote. the idea of students taking 
more courses in science and mathematics, rnnf;^rt and 

television programs for students such as 3-2-1 Contact, and 
nreparing Publications for elected officiiTs, such as school board 
members which describe the current problems with science and 
rafhe^aticre ucation and means for solving these problems. 



•a'. 

b. 
c. 
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. ^ . Chapter 3. Projected Costs and Effectiveness 

of Single Interventions 

While they are grouped within the indicated eleven categories, each 
specific intervention in each category must be examined individually to . 
determine its projected cost and effectiveness. As noted earlier however, 
limiting the analysis to separate individual interventions would be 
inappropriate because of the systemic nature of the situation under 
consideration. Thus, in the next chapter of this repor. . attention w 1 be 
turned to the value of various combinations of interventions. A specific 
analysis for each single intervention, however, must be done first. 

For purposes of describing the projected costs and effectiveness of the 
interventions, the eleven categories are grouped within four clusters. These 
four clusters are the three objectives described- earlier (quant ity,-~qual-ity, — 
and appropriateness) and a fourth cluster designated as facilitating 
interventions. Each of the first three of these clusters contains one or more 
categories of interventions which are expected primarily, though not , 
exclusively, to directly promote attainment of that particular objective. The 
fnurth cluster facilitating interventions, contains categories of - 
I re ent?o;r;h;ch, though^ot necessarny promoting directly . 
of any of these three objectives, potentially are of benefit in changing some 
aspect of schooling that in turn Will foster attainment of one or more of 
these objectives. The four clusters and the categories of interventions 
contained within each one are presented in Tatjle 1. _ , f4.«„f;„„. 

Estimating the cost of a particular intervention requires that attention^ 
be qiven to possible costs to a variety of agencies and individuals such as,, 
federal and state government and local school district expenditures teacher 
and pupil costs and costs incurred by industry in the case of donations^f rom 
That sec or The type of costs included are both direct costs and. oppor un^ty 
col s Tabie 2 contains a definition of each of the cost categories including^ 
■state and local district expenditures (S & L). federa .expenditures (F). ,^ 
expense and opportunity costs incurred by teachers (T . educational^ . 
opportunity co s'ts for pupils (EOC), expense and opporturrrty costs f-er-RUiH^^ 

and their f ami 1 ies. (P) . and costs incurred by ]"5"5^'"yJ^^,„^y4re, h.ci«; '^nn 
A full description of the costs for each intervention and/The basis on 
which each was calculated are contained in Appendix A. A sumitiary of these 
costs is given here in Table 3 where 5 & L and F have been .^mmed together 
under the column headed "Tax Monies" and the EOC and P categories have been 
summed together under the category labeled "Pupil Cpst. / n.mil 

^ All costs presented in these tables are presented as the cost per pupil 
per year. Some costs were substantial sums which were prorated over a number 
bf years. For example, the cost of remodeling a school classroom to convert 
it to a science laboratory was prorated over a ten-year span. In another, - 

s ance Snservice education w5s assumed to have a "life" bf ^^^e years an • 
was prorated over that period of time. The only costs not presented in this 
manner" were the costs of public education (one of .the eleven intervention^ 
cat^qorips). In most cases, the cost per pupil per year is in essence the 
oJst of providing the particular intervention for the sake of one class in 
/Jhich that student will be participating over the^period f .^"i;- 
For example, an intervention which causes the student to take an additional 
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Table 1 

Interventions Grouped by Primary Objective • 

Interventions Primarily Related to Objective #1: Quantity 
1. Increasing Student Requirements 

interventions Primarily Related to Objective #2: Quality 

1. Preservice Preparation of Teachers 

2. Enhancing Teaching as a Career 

3. Improving Instructional Practice 

4. Inservice Education 

5. Improving Materials, Facilities and Equipment 

6. Assistance from Business and Industry 

Interventions Primarily Related to Objective #3: Appropriateness 
1. Improving School Curricula 

Faci 1 i tating Interv^^i-tdns — ^— — 

1. Improving Local Leadership 

2. Testing Programs ^ ^ 

3. Public Education . 



Table 2 

Definitions of Cost Categories 



Code 



Cost Category 



Description 



S & L 



EOG 



State and local 
district 
expenditures 



Federal expendi 
tures 



Expense and 
opportunity 
costs incurred 
by teachers 

Educational oppor- 
tunity costs 
^for pupils 



tunity costs 
for pupils and 
their families 



Costs incurred 
industry 



by 



Includes all direct expenditures by school 
districts, the source of which generally is 
state or local funds. It also includes Any 
direct expenditures by the state for programs 
initiated at that lev'el. 

Includes all direct expenditures by the federaV 
government for the given intervention. To 
whatever extent federal funds indirectly 
support an Intervention through regular school 
district budgets, it is included in S & L 
above. It also includes the. cost of tax 
reductions received by industry for their ' 
donated assistance as described below. ^ 

Includes ajll direct expenses incurred by 
■ teachers' or prospective teacher's and 
"opportunity costs resulting from their 
participation in the intervention. 

Reduction in non-science education due to 
reallocations of time and resources to scie.ice 
education. It is valued at its cost. 

It inrliiriP<; all ex p ense and opportunity costs 

incurred by either pupils or their families 
with the exception of educational opportunity 
costs contained in EOC above. 

Costs incurred by industry as a result of.t.heir 
donations to science education reduced by the 
amount of . the tax benefits they receive for 
their donation. 



TOT 



Total 



Total of all of the above categbries. 



23 



Table 3 

to 

Costs of Single Interventions 
(Dollars per Science Student per Class per Year) 



Intervention 



. Quantity . , 

1. Increased Student Require- 
ments 

a. Increase graduation $630.02 
requirements (1 course) $30.02 iouu.uu 

b. Increase college 

■ tfiouise/'''''''"'"''"'' . 30.02 600.00, 630.02 

" .™yelnrwfeks) 333.40 Z 536.00 . 869.40. 

c' Increase length of . . 901.99 

school day (1 hour) 500.00 401.99 ^ 

d. Increase homework 1.59 100. bU 

e. Increase percentage 

of class time used i en 1.59 
for^Jn struct ion 1'59 ^ ' 

f. Increase scheduled days Kn nn 60.00 
used for instruction 

g. Increase academic 

requirements for parti- 301 50 301.50 

cipating in athletics jui.ou 

B. Quality r 
1. Preserv.ice Preparation of 

Teachers - ' ' 

a. New standards for teacher _ ^^^g^ 
preparation programs . ^-oo 

b. Greater science- require- ^ 
ments for elementary. .--^^73 
teachers ^'^^ ^-^^ 

c. Specialized science ' . .fi 8 96 ^ 11-84 
teachers in grades 4-6 2.aa a. so 

* d. More courses emphasizing , co 4 97 

applications of science 1.39 3.58 . • _ 
e. More "hands-on" work in 

. teacher education . .10.99 

• programs . ^u.^^ .. 



Table 3 (continued) 



Intervention 



Teacher Pupil Industry 
Tax $ Cost Cost Cost 



(S & L 
and F) 



_ Total 



(P and 
EOC) 



(I) 



1. Preservice Preparation of 
Teachers (continued) 
' f. Student teachers only 
with outstanding 
cooperative teachers 
Employ, only fully 
certified teachers 
Interest-free loans for 
prospective teachers 



h. 



b. 



c. 



2. Enhancing Teaching as a 
Career 

a. Increasing salaries of 
all teachers ($3000) 
Increasing salaries of 
science teachers ($30PQ) 
v.. Performance pay 

d. Improved^ professional 

environment 

e. Local teacher recogni- 

tion campaigns. 

f. Improved teacher recruit- 
ment and placement 

g. Involve teachers in 
collaborative educar 
tional research 
Better supervision and 
evaluation 
Reduced workload " 



h. 



3. Improving Instructional 
Pr act i ce 

a. Improved teacher-student 
ratio 

Mastery learning 
Computer-assisted 
instruction 



0.18 0,30 



11.39 



b. 
c. 



$26.88 

2.15 
3.58 



0.08 
0.09 

5.35 

3.58 
240.00 



240.00 

1.82 $0.27 



0.48 
N/A 
11.39 

$26.88 

2.15 
3.58 

N/A 

0.08 

0.09 

5.35 

3.58 
240.00 



240.00 
2.09 

N/A ' 
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Intervention 



Table 3 (continued) 



Teacher 
Tax '$ , Cost 



. Inservice Education of 
Teachers 

a. Summer institutes for 
teachers 

b. Academic year, full- 
time institutes 

c. Late afternoon or evening 
institute classes 

d. inservice on application 
of science 

e. inservice on (nore 
advanced aspects of 
science <■ 

f. Inservice on teaching 

methods 

g. Inservice coordinated 
with local development . 

h. Teacher centers 

i. Extended year contracts 
for program development 

j. Improved teacher 

evaluation 
k. Sabbatical leaves 

5. Improved Materials, Equip- 
ment, and Facilities 

a. improved materials, equip- 
ment, and facilities 

6. Industrial Assistance 

a. Seed money for educa- 
tional projects 
' b. Providing cash awards 

- c. Equipment donations . ^ 

d. Loaning lecturers and 
workshop leaders to. 

- „ schools . 

e. Rotating employees into 
classroom teaching 



2.57 
44.15 

2.18 
' 1.82 

1.82 

$1.82 

1.82 
2.11 

6.42 

3.58 
23.12 



5.30 



0.72 
0.72 
0.72 



0.49 
30.46 



0.09 
7.09 
0.27 
0.27 

0.27 

$0.27 

0.27 
0.27, 



$1.07 
1.07 
1.07 



^ 0.73 



'45.70 



2.66 
51.24 
2.45 
2.09. 

2.09 

$2.09 

2.09 
2.38 

6.42 

3.58 
23.12 



5.30 



1.79 
1.79 
1.79 



1.22 
76.16 



Table 3 (continued) 



Intervention 



Teacher Pupil Industry 
Tax $ Cost Cost Cost 



(S & L /-rx (P and 
and F) ^'^ EOC) 



Total 



6. Industrial Assistance ' 

(continued) ' - 

f. Evaluating and n ib n "^n 
developing curricula 0.12 0.18 0.30 

g. Summer employment for 7 /in 19 
teachers 4.94 7.40 12.34 

C. Appropriateness - '. 

1. Improving School Curricula 

a. Developing more courses " 

with science applica- - cq 

tions (local) 0.59 0.b9 

a. ' Developing more courses 

with science applica- ^ «c 

tions (federal) 0.05 0.05 

b. 'More rigorous courses for " 

college bound (local) 0.59 "-^^ 

b: More rigorous courses for tn hk 



N/A 



college bound .(federal ) ' $0.05 
c. Reducing number of 

"frill" courses 
(J. Federal funding of new 

curriculum development ° ^ 

projects 0*05 

e. Revising "old NSF" „ ' n "^n 
courses locally ■ 0.30 ■ , 0.30 

f. Developing model cur- 
riculum patterns for . ^ n nc 
districts . . 0.05 0.05 

g. Training for local ^ 
personnel on curriculum . 

development and imple- ri y\ 

mentation ■ 0.13 ^-^^ 

h. Regional consortia for ^ 

curriculum development 0.30 "•-5" 

i. New standards for text- 

' book adoption « 0.05 . 0.05 

J. Improving program n n-j 0 03 

evaluation 0.03 . _ u.uj 
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Table 3 (continued) 



Tax $ 



Teacher 
Cost 



Pupil 
Cost 



Industry 
Cost 



Intervention 



1. Testing Programs 

a. Awareness conference for 
local testing personnel 

b. Test item banks for 
local personnel 

c. Awareness conferences 
for test publishers ' 

d. Informing local 
accountability 
''committee members 

3. Piiblic Education 

a. Media advertising to 
promote science 
education 

b. Science television 
programs for public 

c. Adult education courses 
on science and 
technology 



(S & b 
and F) 



D. Facilitation 

1. Improving Local Leauersh,ip 

a. Increasing the number 
of science supervisors 

b. Revised-job descrip- 
tions, for local science 
supervisors ^ 

c. Revised job descrip- 
tions for general 
curriculum personnel 

d. State or federal funding 
of local leadership 
development program 

e. Training for school 
board members 



3. 00' 

0.75' 

0.75 

3.50 
0.05 

$0.01 
0.02 
0.01 

0.05 

<0.01 
0.35 



(T) 



(P and 
EOC) 



(I) 



Total 



3.00 

0.75 

0.75 

3.50 
0.05 

$0.^^ 
0.02 
.0.01 

0.05 



<0.01 
0.35 

c 

N/A 



2& 

course. in science is an intervention that affects one class of the student's 

school day over the -period^-Of Qne^schpol. year_. „ , . - 

While the cost calculations assume an "average"' sized Gchool district, it 
is recSgntzed that the costs and feasibility of many ^^^f ^- .^^^^ 
iith the size of district. In most cases these variations do not signifi- 
cantly alter the conclusions drawn from the analysis. In those cases where it 
does ths effect upon the conclusions is discussed in connection with the 
sDecific intervention, e.g., curriculum development or testing programs. 

Mariy headers may be inclined to attach more importance to the costs 
rnnt^ined inaparticular column than some others. For example, the taxpayer 
r olmcl? deader may be inclined to give most weight to^^f .^o-f.^^JP^S^,^^ 
anH attach lesser importance to a matter such as "Pupil Cost in the rorm or 
onnortunity costs or lost wages to the student as the result of spending more 
Ji^in school WMle various individuals m.ay have different va ue judgments 
in ?h s reqa?d one should not lose sight of the fact that all the^costs 
esc^ibeS in this analysis are costs to society and that other individuals may 
-we-l-l-h ave-..dltf erent ,v-aJjies_as_to jLAe ij^^ 



reaSr-m: t^^^^^ 

costs are only described in general terms in the chapter narrative. For 
purposes of discu sing the various interventions, however, these general, 
SacrJinHnns of costs as low, medium, or high may be most appropriate. In 
descriptions of costs J.^'^' ^^5^3^ ^an be attached to the information for a 

n?;pn ^nte^vent^r butTh^^ the substantial variations in the 

^inditloSrunSerihic^ could be implemented, caution should be; exercised 

^'°"\iriri;ir^reffecri:re;s vary among the objectives; they will^be 
discussed w thin the context of each objective. On. the pages which follow, 

-?hp rn^t and effectiveness of-eacli-Wt-efvmt-iW-W^re-ss-^^ 

!uh?n JhrfourclusteJfof obje^ .At the end of the chapter, several 

m Hce wi be e e^^^^^^ portray the relative costs and effectiveness, 
o^elch 0? e single interventions within each of the clusters of objectives. 



A. Interventions Primarily Related to 
Objective #1: Quantity 



The criterion for effectiveness of the various, interventions proposed for 
this object ves time encfaged in learning. It could be argued that the basic 
c? ter^Jf s o^J^FscofeHrtests of student learning, but to facilitate 
^hs analysis the criterion ideally should have as close a linkage as. 
no siblewth'the intervention. The criterion of time engaged in earning has 
Kpn .hown by cons derable research to be highly related to student earning. 
So the ?Hte?ion of increased time engaged in learning will be used m Ueu of 

'"''^Alf of ?SrspIc?nc"i;terventions under consideration with respects to 

Each iSe is examined individually as to its cost and ettecti veness. ^"ote that 
this category ?nJolves significant costs for both the taxpayer and students; 
both costs are considered. v 
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- a Increasing t hf> graduation requirements ' in science for all students . 
This int ervention Consists ol increasi ng the required number or science 
Siy? Tft^ For example, a semor- h;gh that 

cSJ^ently requires one science bourse for graduation may increase the, required 
number to two courses , ..^ium for the taxpayer. and 

hiqh T^TThe p pi Theoretically at least, the students will dimply a e 
less of some Sther courses so they can take more science Thus, the total 
number of teachers, classrooms, textbooks, etc.. will not change. But there 

some real costs, including what may be called transition costs. A 
substantial cos? woild be remodeling classroom space to provide science 
laboratories and stocking them with the necessary supplies and equipment . • 
labora ories ana s 0 ^^^^^ intervention. One is e loss 

of stu ent Warning in areas other than science. To whatever exten other 
courleT^^^^i^^^^^^ requirement, the student 

loses knowledge from the other area. In essence it is a simple trade-off but 
U still must be recognized as a cost, since there are other interventions 

Yp? Another Dotential cost (not included in the cost calculations) , 
relate to tecu;'shortage ,of. qualified science teachers. To whatever . 

f nf ^HHiHnnal science teachers must be hired from "among candidates with • 
fu ft ndl a frcSs 'fhe overall quality of U.S. science teaching is 
lowered Similarly, if non-science teachers in a particular distr ct afe 
rea g ed to teach science because their major teaching area as os 

enrollment due to the increased science '"e^^l^'^^^^^ JS^,,?'.?^ o re?ra ^ non- 
Iri^ncp tPachina is lowered. In some cases it may be feasible to retrain non 
^^pnce teachers so hey are qualified to teach science, in which case the 
4Xi-^o-Wed^Libe-th^^^^^^ 

Telc^iirand^Sf^o^of inadequate science teaching due to a lowered quality 

°' "uveTessrVSe'effectiveness of this intervention . in terms of„the ' 
nivpn^^nfMrTi^ potentially high. To whatever extent the new science 
?equ rS^ h] h r than the amount previously taken it wi 1 resu in . 
students being engaged in science learning for a greater period of time. 
.. furthe analysis, however, leads to some important reservations about the 
notPntial effea veness of this intervention. Most of the college-bound 
TtSde^ s in a typ cal school already are taking more than the minimum requ red 
students in d increased requirements will have little effect 

oTtE slo 0 rough ^ha I ™sch^ population, The S/oup it win 
affe2i is large y the non-col lege-bound students, sometimes referred to as the 
general or non-academic student. Since increasing the scientific literacy of 
all students is generally regarded as an important goal, ^his intervention 
I^Tl eems to be an attractive one. but some other considerations appear. . 
HPPd also must be paid to another of the^ three objectives, namely the ^ 
Heea a'so must pa u u current science curriculum of high schools 

des^q or he^^o^^^r^^^ is it appropriate for all students? 

t bab S i no,t app?opriate for. all students, so the appropriateness issue -, 
also must be dealt with before a final answer can be given on the 

^rflaifeT^SroT-thTs-^^^^^^ 

^vl?pm ^nature of the issue at hand and leads to a final conclusion: this . 
rtrrvent^o^will have h gh effectiveness in increasing the" amount of time 
Engaged in science learning if the appropriateness objective also is attained. 
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b Increasing co llege admission requireme nts in science for gH incominfl 
freshman / " T his nlerventfon consists ori ncreasing the number or mgn school 
science c ourses a student must have taken before a college or university 
admits them for study. The number -currently required for admission to . 
colleges ranges upward from zero, a not uncommon minimum, to a high of two (m 
all but a few unusual situations). ■ ■ ■ l^ 

Cost: The cost analysis for this intervention is sim lar to that of . the 
nrevi^intervention. i.e., medium.for the taxpayer and high <^or pupils, 
previous intervent 0 intervention must, be implemented by individual 

colle qes Us impac t on the number of students taking more science in a given ■ 
high Ifhoo s likely to be relatively small, or at least very gradual, unleis 

ft number of colleges making the change is l^;:9e,^;d (2) the 
reaulrements is not only beyond current, requirements but beyond what the 
in^om^ng students currently take. The effectiveness of thvs intervention is 
difficult to determine without data on both current requirements among 
colleqes and on the number of credits in high school science among incoming 
college freshmen. Several institutions recently have incr^^sed their 
admission rep'irrmWs'frW-tW-to-thre^^^^^^ science. , • 

Implementation of this intervention probably will vary widely among 
colleaes The many colleges (about 40 percent) with an "open-door" approach, ■ 
i'^' adiit any high school graduate, probably will not introduce a science 
rpnuirement since it would require a fundamental change in a basic 
^nft tuUona Salicy. Most. of the colleges having certain requirements for 
admission al 0 compete with each other for students during this non-growth . 
era Thus they often are reluctant to increase admissions requirements of 

s nl tu e un es? their "competition" is doing so also On y a rninori y of • 
institutions of higher education probably , are in a position to take unilateral 
-action~on-a"change~of~th-is-n-atnre-; — — , ,„««a^c it 

Colleges probably will take action, on this intervention if it appears it 
will improve their own programs. In that regard, college personnel are 
^adv sed to review the research on the effect of high school -preparation in, 
science on college science performance, informatipn wh ch will be examined ^ . 
briefly in a latter section of this report (see page 53). . 

c Increasing the len gth of the school day or the school year. This 
intervention consists of increasing the amount of time students are in schoo 
ea h Say 0? lengthening the school year by some, number of days or weeks -This 
action could be taken at either the state or- local level, although state 
acUon ivprobablj the key since state financial support for schools commonly 
i<; tied to student attendance, ^ ' . 

Cost The cost of this/ intervention is high for both the taxpayer ^and 
DUDils^For the taxpayer, the cost is approximately a prorated portion of the 
?ufrent non-capital expenditure portion of the cost of schooling. The current 
non-capUal annual per pupil expenditure in. Colorado is approximately 
$3"000?^ Assuming a 180,^day school year, the add tional per P"P ^ "st of 
extendinq the school year/would be approximately $83 per week.' Similarly, if 
?he School day were eften'ded by 17 percent, i.e., by adding one more class 
• each student's schedule ybr lengthening each class by 17 percent, the^ 
anticipated cost would be an approximate 17 percent increase in the non- 
•raoital exoenditures portion of the budget or' an annual increase ot 
rp^roximatelJ ssOO. per student. For the pupil, the opportunity costs are high 
if either the school day or the school year is lengthened. 



31 

Effecti veness ; Assuming that students would participate in an extended 
crhn nV ^av nr scho ol vear.at the ^ame rate as the current program, this 
S 'er en io w e'eff active in increasing the amount of time students 
iSuld be engaged in learning science. This intervention is not different^ial 
with relpect to science. The time engaged in learn ng would mcrease 
SroDonionately for all subject areas. The impa^ . is quite predictable and 
SeasSrable! Since non-capital expenditures constitute te larges portion of 
school budgets . the cost and effect are close to direUly proportional. 

d. Increasinq the amount of homework assi gned to students. This 
interven fion consiits ' o fa change in the instructional practices teachers 
While basically a simple increase in the amount, of . homework assigned, „a change 
in the character- of the homework probably should be considered also. _ 
Costs'- The cost of this intervention is quite low for the taxpayer and 
mediuriof students. It has virtually no impact on most parts of the budget, ^ 
even for supplies. Consideration should be given, however, to the cost of 
in'.ervice education for teachers ip how to develop valuable homework, 
activities which are an integral part of the classroom instruction and hive 
the hiqhest probability of being done by the students. Ttf whatever extent 
uch changes in instructional practice are relate^ to ^^^anging he curriculum, 
there may be some costs relative to curriculum improvement. All things 
rnn<;idprpd however, it is a low cost change. ■, ^ 

Effec tiveness : Although one cannot simply generalize the resul s o the 
high, school setting , there is research conducted at the co lege level which 
offers some insight^ as to the potential of this intervention. The research 
literature on college teaching shows that what a college professor does to 
nue ce how students use their time, outside of class as more impj^t on . 
-student learning than any other aspect of their instructional .work. Other 
e ear h at the'secondarj school level shjgs directly ^^at ncreased omework 
can be used -to increase student learning*'" To whatever extent the. high _ 
school teacher can influence students to do more .work outside of c ass, the.re 
Vs 'eJery reason to expect it wilUnot only increase the amount of time engaged 
. n 1 arXi b ; increase learning- as well. When compared to t ^ amoun^^of 
time spent in class, an additional 20 minutes per day engaged in learning 

0 ?side of c ass is a substantial amount of time. This arbitrary figure of 20 
minutes oer day is picked for illustrative purposes only, but the basic point 

1 to em hasize that an increase in homework from zero to 20 m nutes per day 
ir from 20 minStes.per day to 40 minutes per day s a substantia increase 
and has the potential , if done properly, of significantly increasing the 
amount of time students are engaged in learning. ^ ' 

The success of this, intervention is probably dependent upon some of the 
other Dotential interventions. For, example, improving local eadership may be. 
necessary to provide the stimulus and assistance to put this intervention into 
oractice. Simi larly. inservice education focused directly upon this 
i^?er ention may be necessary arid a change in the school curriculum may be of 
help These interrelationships give further impetus to the idea that the 
total process of making change in the sch^ools is systemic. 

P Tnrr^.cinn thP oro oortion of total class time devo ted to instruction. 
This inte rvention gonsisgs gf fostering teacher behavior chang e sue that more 
time is devoted to instructional activities and ^ ^o socialuati^^ 
administrative details^ and maintaining order, [^ese other functions^a^^^ 
important, but the bas c thrust of this intervention is that student time win 
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be devoted.s .uch as possible 

?:rrn?ngra"es°grel?" fZ Ij^cSlr'to teacher, fro. as low, as 50 percent to 
a high^approaching 90 P|--t.^^^ ^^^^.^^ ^^^^ taxpayer and 

stud.^Cos s fo? the school are essentially those of motivating teachers 
a S hll^g them acqyire the new behaviors needed to ma e this c ange These 
?osts baska ly are for well designed, targeted, inservice education and 
aSditional supervision and support to assist in implementing the desired 

"^'"Effectiveness: The effectiveness of this intervention if implemented 
is hi- qh a ndica ed by two pieces of data. The first is the wide var ation 
"Tn thf current percentage of time "on; task" a indicated above. ^Secondly, 
data on the eff^tiveness of training programs designed to help teachers in 
this' realm indicates change can be made. ' 

f Increasing the proportion of scheduled school days actual Ty devoted- 
lah e? Th 1 s 1 n ter ve n tton - c ons rs ts ot-reduQ i ng -the; number -oT-e-Tass- — 



■ Mit-.n;?;: ;jSror3a;rde«Urio""nor-iS.-t?uct?on;i"-activU,e. such 

« ^^Jo^n'-'^he'^rsf if"tMr1n?:?re„t?rn'n C)^^^^, involved: it 
!<; balTcaTlv the loss of student involvement in other activities. 

• mec ivenLs. The effectiveness of this intervention, in increasing the 
amoun t of dent time engaged in classroom work is largely a function of the 
X to Which it .-s implemented. To whatever ?'<tent a par icu r school 
do^s devote a large amount of time to, such "non-mstructional activities,^ 
there n the potential for making an effective change. -The amount of time , 
4evoted~to-^s^s-emb-Hes-and-s-imi^ acti v-itles-i|i-a_m presentati ^ 

subS^ban sSoold strict was found to be 4.1 percent."^' J^i^s amount of t me. 
less JhanU hours per week, is not large enough that a significant amount of 
•additional instructional time could be found here. 

a TnrraA.lnn th P academic requirements (grad es) for student participa- 
t i on n a h eti Ihis mterven l . Hn consists ^of^ncreas . ng the minimum ^ 
grades required o f a student^ before he or she may participate in the athletic 

'"""^'"fo^ts- The cost of this intervention is low for the taxpayer and medium 
for tHrHudentl affected. It is.essentially the loss of athletic experience 
o^tS^^art of some studerrts who would no longer qualify to participate in 

'^^^ Iffectiveness ; The impact of this intervention on the amount of time 
stude nts spend in 'learning (whethef in or outside of class) is hard to ., 
determine The strong desire many students have for participating in 
at^let c!' however, may indicate it could be a significant motivator .The 
fuJreSt requiSnt basically is that a student be doing passing work in four 
.uSiects I Colorado, a stJdent cannot^ have failed more than one course the 
D^eJiou 'semester/^ The number of students whom this intervention would • 
affe ? however, probably is quite small; it would afff ^ J.^^^ 
minority::of athletes unless the requirement were raised substantially. - 
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B. Interventions Primarily Related to 
Objective ni Quality 



• ^ As indicated earlier, quality of instruction is more difficult to define 
than quantity of instruction and It is more difficult to demonstrate that 
whatever we define as quality has an impact on learning. Calls for increased 
quality of education most often refer to increased teacher competence in terms 
of knowledge of science, skill in teaching or dedication to the job; 
occasionally increased quality refers to better facilities, equipment and 
materials. Since quality includes so many dimensions, it is not possible to 
make a simple demonstrable link between it and learning. Various indicators 
of quality musti be addressed "one by one in connection with particular 
interventions. ! Each will be examined individually as' to its potential impact 
on^student learning based on available research information. The single 
interventions in this section are grouped within six categories including 
preservice preparation of teachers', enhancing teaching as a career, improving 
1 nstruct 1 onal p^act i ce , "i nTeWire"eiiircat;1W7- M mpr ovi ng'mat^^^^ f adti t i es , " 
and equipment, and assistance from business and industry. The costs> of the 
interventions in these six categories are to the taxpayer or the teacher. _ 
Since these costs can shift from one to the other relatively easily depending 
upon district pb-licy (e.g., payment or non-payment of teachers for 
participation i|n certain types of irtservice education), no attempt is made 
below to distinlguish between these two categories* 



1. Preservice Preparation of Teachers 



These interventions are intended to improve the preparation of science 
teachers prior to their initial employment. They pertain to all aspects of 
the college program including (a) general liberal arts background, (b) study 
in the major field, e.g., physics, chemistry, biology, or geology, and \ 
(c) preparation in professional education. „Eacb of a series of interventions 
for improving. some aspect of this preparation' is analyzed here in terms of 
cost and effectiveness. . 

..a. New standards for teacher preparation programs . The proposal is that 
units of state government certltying- teachers establish new standards for 
preparation programs and enforce them in the credential ing process. Opinions 
•vary as to what form these new standards should take and the intervention has 
to be analyzed in these somewhat undefined terms. Whatever the specifics, 
however, the intent is that the standards be more rigorous and demanding. 

Costs ; The^-cost of this intervention is low unless it requires the . 
development and/or addition of new courses in a college program. If it is 
sitnply a matter of requiring teacher, education students to take certain 
courses they did not take in the past; the impact on enrollments in courses in 
most institutions would be minimal and not result in significant programmatic 
•changes. If, as assumed here, the new standards require the development or 
new courses or an increase in the l^th of 'the-progra costs i\re 

involved. • . r 

Effectiveness: In order. to evaluate the effect! veness , of this » 
intervention, one must have some knowledge of the relationsh°ip between such 
preservice preparation and teacher's subsequent performance in the classroom. 
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research shows that ''^^^^^"^'"SSU^^'kI research Indicates. hdStver, 
?hardU i^en r,?^ r ' '.are IS ?^e?s \o so^e extent based oAeir 
:5?en«""r; u^d! their P-paratlon In ^.lona e .ca on n helA^^ 

^r'?Ld"?tst'% °3 t g" W of^lsoc^aJ^on betweei 9 percent 

p^rJSStf d:"n5t-;gl, teat K^Pe th t tjj.Ker preparation progr^^^^^^ ) . 

^' ?"/rnd%?eoa?e"tea Se?s'v.S "a a " st.d n f 'the^l^i ves . ha.e'a strong 
^5%: Ur^en 1 't o:?J"beTurfled even though the resulting 

-rr"f hSS^'d?rtr^? r^:5^hrs2pSraSd zx^^X , 

ratfgiJrand win be addressed speclfically in that context. 

h Greater science re ouireinents for elementar y school teachers The 



intpnt of this intervention is x;o reMuirc una*- c .c...^.. vv^. ^ ^ 

ecfve more science training in their teacher preparation programs; 
typical minimum requirement now is two science courses. 

e ItioS 0 r°a.. Assojing that '"J ='"^"5 "^^tTo" I slate f «1d1ng : 

schooling. jhe positive, though low, correlations between science 

ral\cte:?e%;plJln s rta arrhS:';ie^eS"r5 s^hoo, as official 

t^e ^y^^:]^^^ Z l^;^rn?a?rscl"oU. {hirinferJentlon , 

■'a^S Id be tlefJS sS^h "t^rrentlons. as district e/^^^ 
amount of time elementary school science IS taught. 

r SoeclaTized ^re paration programs for scie nce teachers 1n grades 4-6. 
The inten t^'s to'prep^re%eachers^h3 are science special .sU. tor graces .-o. 
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<i.mr,^ctinn thIs dctlon 1mpHes concurrent attempts to departmentalize 
<??^uJlinn in the uSSer elementary grades so teachers may specia Ize by 

eaJ q a e t sSmed that'such an elementary teacher would have a 

? < ^^fnt!i\r Pnre backqround 'of 30 semester-hcurs or m6re. 
minimum Ota ceneacgro n^^^ loss of know edge in 

other^as resulting from a shift away from other of courses n the 
nJntnprUve teacher's collage program'. If this preparation ultimately leads 
; Tp oi^ent nTspecillized'po^tion teaching mainly ^cience t e o 
• backgfouJd in other areas is not of major consequence. ^ .f"^^ ^^J^^/^J". 
sSl practice do not occur, the cost may be significant due to a lack of 
preparation f" teaching other subject areas in the elementary school 

""""ISJeaiveness: In view of the previously cited positive, though small. ' 
cm-re atfons betwe en science background and J^fhinS Performance t 
intervention is viewed as having a positive but small effect.. Its full 
benefits require programmatic changes in schools as well. 

d More courses emphasizing the applica tions of science. This 

interven tion consists oi^ddlng I Lhe ' ^^cher preparation program cou^^s 

lip t t'asp ? f rec.h"n"ogyf appl ication^of science to the personal .needs 
if Seople in such areas as health, energy conservation, and common 
?echnoloqical devices, and such societal issues as nuclear power 
env?r6 ml tal concern^ world food supplies and "^^lona security.^ The 
tjpica" college science major currently is lacking in attention to such 

'^°''^^rn<;f Althoudh a few courses of this nature have been added to the 



ic riistTu i i r 1 V sm^iu-TSVh^iev^^ extent this ^ 
ntfr en i m rre ire^ to existing sections of courses of this 

nature the cost (low) to students is, the loss of information some 
ptiminated area To whatever extent such courses must be added to the 
clrr c urn the' institution faces course development costs They inc ude 
^^rutv time and expenditures for new library materials and laboratory 
lauii^en needed fSf he courses. Implementation of this intervention may be 
Ta^litated by development of model courses in selected institutions. Federal 
g?anis to a limited nSmber of institutions maybe valuable in stimulating the 

''''IffectWene^r'This intervention is related more to the objective of 
nIl!?onpc^ th an t is to quality. Given the extensive efforts probably 
n 0 J chaS es"?n appropriateness, .as will be described in a 
u?pr section of this report, this intervention by itself is probab y of 
ftne con eSuence. On the other hand, this intervention- potentially^could be 
1 siq^fi cant contributor to a multi faceted endeavor to bring about change 
with respect to the third objectiye-apprppriateness. 

p More "hAnri.;-Qn " work as part o'f teacher edu cation programs. The. 

r;fals!^ralr9%or"sr.S;iio"';Jd':o""g .nl ..U students in actua, 
' school situations. 



ERIC 



39 

vV-.- 



36 



Cost- The cost of this intervention may be resources for developing 
'tnodifT^ions to an existing program without changing ts length or it may 
require lengthening the program. It is a medium "t intervention. 

Effectiveness: There are considerable Indirect data indicating this 
inter' vention' would have a positive impact, but the magnitude of the 
Sp^Svemen? is d fficult to assess. Based on the limited nformation 
available if fuVly implemented it probably has more potential for improving 
?eaJher education than any other single intervention in this category. ^ 

f PiArinn .tudpnt teachers only with, outstan ding cooperating teachers. 
This action imoties greater care in selecting cooperating teachers wun wnich 
sEidentteachef are placed to insure that the cooperating teachers aje truly 
outstanding and not jSst , average. It assumes that.placements currently are 
not made on this basis as much as they could be. 

Cost: Two costs are involved in making such a change.^ One is the 
greater-expenditure of time by university personnel in locating such teachers. 
The second cost is somewhat increased transportation costs for the student 
tPacher This increase in cost is low and is based on the assumption that 
-"tSlrk^Wive^ 
to locate the cooperating teachers. . / , ^ ^ ^ . 

Effectiveness: There are few empirical data to establish the 
diffe rential effec ts of placing student teachers with "outstanding 
ciope^a! nd tiachers as compared to "ordinary" teachers, a though' the 
• conventional wisdom is th&t there is a major difference. Inferences- from ^ 
. mwh J related research, e.g.. studies of "modeling";for Jeac^ng particular 
teachina behaviors, support the contention that there is a difference. The 
magSiilldVo? Change likely to result is largely in the realm of speculation. 

— q — ^j^om -enforcemerrt-of-the-requ-ir-emen^s -that-school dJ^tdci^^^^ 

only f.'.n VFT^H^aled teachers, i.e.: not hire teachers on ■'emergency ^ 
r:lUArL<.'> nr "letters of authorizati on." Data from a survey conducted by 
^^f^.vJ.lit:. } e 'i^^.^. \ ^.rV.aY'c Accnnatio T^indicates that approximately 



certificates" or "letters or autnor izat j uh. ua«.a « .-^ 

the Nationa Science^ leachers Assoc. at. o lTindicates that approximate^^^ 
50 oercent of the science teachers hired.in the United States for. the 1982-83 
sSh^orrear were noJ fully credentialed.^^ The intention of this intervention 
is to restrict school district's .freedom to hire such teachers. _ 

Cost: The cost pf this action is low unless one carries it to its 
ultimirTconclusion and faces the choice of having either a less than fu'iy 
credentialed t'eacher or no teacher at all. Under these circumstances the cost 
of the intervention could well be having no teacher and eliminating 
?nstruction in the given science classes for that year. A possible long-range 
conseq5en?e higher saUries paid to teachers in order to attract ones 

^''"^^fectlJeLssf 'fhiftiiterventio^ is probably of little effect simply 
becau se when faced with the choice between no science instruction and science 
ins?ruction which is of marginal quality, essentially all schools will opt for 
marginal quality rather than no instruction at all. - • ^ 

h. Loans or scholarships for per sons P'^eP^'^i"^ ^^^^^^^"f^ '^f.^^.l^f''^^^^ 
This inte rvention is offering financi al incentives to, sUidents wno choose to__ 
"^r"TTres"^i"re"science-tW . 
attract students who would not otherwise enter them. Such financial 
incentives could be either interest-free loans or scholarships of varied 



amounts. 
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- .fHhi^ intervention basically depends upon the amount of. 

medium cost '"'e^e"'!""-,-^. .„.„.„ .f this intervention is difficutt to 

Fffectiveness : The effectiveness ot tnis inie simiUr . 

deterSTTiir-TpJst ,nd,ca -on pr b e 

'St a on the eHe of these programs are not l^b'stantial, 

Mc-pe?sonn" of the opinion that -they are attractive. 

2. Enhancing. Teachin g as a Career 

ThP attractiveness of a particular career is a function of many factors 
inclu5?^g1a\rr;-a d other co^^^^^ • 
very individuar.matter °4 f J.^ , f ° o^ake teaching more attractive 
itself. The ^"tent of these inter v^^^^^^^ greater' prestige and .recognition, 
through increase f nc a^ m^^^^^^ in greater " ■ 

and what may be ca led f of this intervention is increased 

personal satisfaction. The ^xpectea r^ebui u ^ teachers . 

^"N^r.d'witr^e^s^han e tiaU; There ^oSld ll greater opportunity 

. employ^ed with ess^tnan ^ .^^ates from among a bigger pool of / 

for emp oyers 0 selec be te, and date^^^^^^ ^.^^^ ^^^^ niot vation to 

effectiveness in increasing the duality of teaching. 

- 'a. jncreasin, th.;;l.rv of t^"-^;" -jSr : itr /^^lu fUnrtnc^els^ 1^ 

:iSl^d-hr^Jr'oss-the-.oard for 

'-'Ct!"^?il :rsrofnhnM?rriL?;f?rhrg"- Since a Mgh.ercenta,e of 

■ r„-Srrrr3:siS":ru,d-re:s^tt^r 

district budgets. pffprti veness of this intervention is difficult to 

. assesf^f^-exl^nt ru h^^ 5^^^^^^^^^^ 

S^aiflheS^ 

be influential. wouia a . teachers' but the correlation between 
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eaf-lier, background in the -subject field and preparation in professional 
education are related to teaching performance. Thus, to. whatever extent the 
riumber of people employed on "emergency certificates" is reduced, the quality 
of teaching should be higher. Assuming that higher salaries do attract more 
people the quality of teaching should rise. Assuming also that hiring ■. , 
officials, are able to discriminate and select the better teachers, the quality 
of teaching should rise because these hiring officials will have a larger 
group of candidates from which they can select. If there are more persons 
credentialed as teachers than there are employment opportunities, there is an 
opportunity to increase the level of quality By this judicious hiring. 

The likelihood that higher salaries will result in greater job 
satisfaction and thus better quality teaching is difficult to assess. 
Research indicates that among the three main motivators of teachers including 
salary arid'.,personal satisfaction from the job itself, the latter is the major 
motivator. This information still does not establish the extent to which 
salary is a motivator, however, and we have little information upon which a 
convincing argument can be made that this increased motivation would result in 
noticeably higher quality teaching. The major benefit of this intervention 
probably is the former one, attracting better initial hirees. 

b. Increasing the salaries of teachers in science to be competi tive with 
al ternative ~emp loyment j This intervention is essenti al ly the same as the 
previous one except it. is limited to teaching fields, such as science, where 
there is a shortage of teachers. > . 

Cost : the cost of this intervention is the same as the previous one with 
the exception that it is applied only to those areas in which therejs a • 
shortage.^ As^a' result, it is a high co.st action. If applied only to those 
fields and not, to those where supply'and demand are in balance or where the. 
number cf teachers available is larger than. the number of jobs, this 
intervention would pertain toVthe physical sciences and earth sciences, but 
not to biology. Additional co^ts may be associated with any conflict arising 
frpm differential pay by subject field, a matter of some controversy among 

Effectiveness : The analysis of the effectiveness of this intervention J s 
similar to that of the previous one. It also should be noted that there , is 
considerable variation across the, country in the shortage of science teachers. 
The potential effectiveness of this action in a particular region, state, or^ 
individual school district shou.ld be judged in terms of the supply and. demand, 
situation pertaining there. 

c. Establish-performance-pay-for-teachers . - This intervention entails 
basing salary increases for teachers upon their teaching performance, in 
contrast to basing them simply upon the teacher's educational level and number 
of years of teaching experience as is the current situation in most school . 
districts. Performance or merit' could be determined by administrative 
personnel through a variety of means including student's performance on tests. 

Cost: The cost of this intervention could be relatively low if one 
assumeTThat total salary increases will remain the same arid only the means of 
distribution will change. Under this assumption increases would be made upon 
the basis'of performance. The costs associated, with . the intervention are for 
developing a system of determining, meritorious performance. . ^ £• 4. 

Effectiveness: The effectiveness of this intervention is dependent .first 
of all on the ability of administrators to determine meritorious performance. 
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Given that the correlation between administrator ratings, student ratings and 
increases on student test scores is quite low, this consideration is of some 
consequence. Assuming it is possible to make these judgments, the 
intervention's long-term effectiveness is probably dependent upon the extent 
to which it causes, good teachers to stay in tne profession and poor teachers 
to leave because their salaries are not competitive. , 

d. Providing an improved professional environment within school 
dis tricts" This intervention c-onsists of "improved working conditions" such 
as fewer lunchroom 'and hall duties, better office arrangements, better 
secretarial support, and a reduced number of different' "preparations," i.e., 
fewer different courses per day. These specific items are illustrative of a 
broader class of improvements. 

Cost:' The analysis of the costs of this, intervention can be done in 
terms oT'speci tie examples listed above as iVlustrations of this type of 
intervention. Assuming that, monitoring activities such as supervising 
lunchrooms and. halls will be done by non-teaching personnel and that teachers 
will use the time released for additional preparation a(id student assistance 
and not to teach additional classes, the cost of this intervention is the cost 
of hiring the non-teaching personnel. If teaching is not changed and teachers 
are not freed up for additional preparation, however, there is a savings due 
to the difference in pay between teachers and non-teaching 'personnel. 

The cost of additional office space is something that probably is 
effectively addressed only in, the context of constructing new buildi-ngs and 
will not be addressed here. Additional clerical and secretarial help 
amounting to one such additional person for each 10 teachers is. assumed in 

this analysis. ^ . . ..... 

Effectiveness : The effectiveness of these actions is difficult to> 
assess; basically we are left with speculation. In general, it can be said 
that these interventions are favored by teachers but there is little hard 
evidence to suggest a dramatic effect on the attractiveness of teaching as a. 
career or upon the learning that occurs in a given teacher's classroom. At 
the same time, the cumulative effect of many such actions over time may_be an 
important contribution to the overall status of teaching as a career. There, ^ 
are growing indications that actions which reduce the i§olatio.n of teachers 
from professional colleagues are of value. - 

e. Initiating campaigns to enhance local teacher, recognition and 
respect. ^ This intervrintion consists of such actions as programs to honora 
"teacher of the year" in a particul ar. school or^^district and public relations 
campaigns to develop 'a more positive publi c im age of teachin g as a career. .■ 

' C os'tT ^T h"e~1 owTos tT^'pr't eac he r recognition programs generally involve 
adminTTtrative and secretarial time to publicize the program, obtain 
nominations, screen and select the nominee(s) and make "the presentation. -To 
whatever extent the recognition carries a monetary reward, this, would be an ■ 
additional cost. Most such campaigns are conducted with the-personneT-already 
employed in the district and the cost i.s- modest. The cost of a public 
relations campaign, however, could be rather large depending upon the scope of 

■the efforts. . ^ ■ . j-rr- m. *■ 

Effectiveness : The ef fecti venes's of these interventions is difficult to 

assess and largely a matter of specul ation . 



43 



40 



f Tmnrnuina ^^;.rhpr rpr.rui tment and placement services. This ^ 
^' J'^P'^ov^"jJ^^^r[,i!p, Drocedures tor dentifymg. i electing and 
intervention "nsjsts o+ baier procedures ^ provision of 

7aJern? s:?vice"'on%re part'o^iSstrtution, of higher education or other 

, endeavors can r^ange from essentially zero to 

severirFund 5 llarf peJ'tLcher depending upon the ^evel of addUiona 
effort expended by recruiters or pi acement personnel . Essentially, however. 

''pJjprJfvP^ess- In terms of overall impact on education in a large area 
.nrhli^T^ili^'thrnat^on. these efforts are unlikely to have much impact; 
nihpr factors control the qua ity of teachers entering the profession. In 
other factors ' Hictrirt however, increased endeavors may 

Sar^eTbu'to ob?a?n ^irf tSan'u ^fair share" Jf%e available quality 



teachers. 

g 



^r^^elvrh "?he"exrect:3 'benenn"£o?"£rtter reLarch and professional 
■'"•"col?- '?o iha'tever- extent this appro,ach simply displaces current 
;-#rarih-fa™rrrirnr„^J:ac^ 

intervention. fho henpfits of this endeavor could be better 

positive outcome of this endeavor. 

---;^'°7^:■■:rc>^ rB:taa:^:rr::as:^rEig ^ 



made This intervention /rel ates somewhat to another category, improving 
school leadership, which/ will be addressed in a later section of this report. 

1. Rpdur. e work loads, that is have fewer st udents per class and fewer 
classes n p ' r dav fo r each ieacher . V^hile this iriterventlon has the potential 
of enhancing teaching /as a ca rior. it^ismore likely to be utilized as a 
Sirect attempt to impi^ove the quality of instruction. Thus, this ntervention 
wiV1 be addressed in a future category devoted to improved instructional 
practices (3. a below). 

3. Improving Instructional Practices 

The interventions in this category are changes in the standard 
instructional practices employed in schools. A list of all such possible ^ 
interventions would be very long, longer than feasible to address in this 
document. For this reason, only three are included as examples, each 
distinctly different from the others. Some instructional changes can be 
imolemented by teachers on their own, even though assistance in making change 
would be helpful. Other interventions in this category would require action 
by both teachers and administrators, while still others are largely under the 
control of administrators or pdlicy makers. All of them directly affect the 
nature of student experiences in the classroom. — — 

. a. Improved t eacher-student ratio . This intervention, essentially. the 
same as Z. ' f. above, wo uld result in- smaller classes for teachers. The intent 
would be improved instructional quality through reducing the number of 

students in each class. ^ .. u^vi, Voh««i 

Costs- The costs -of this action are very high, affecting both school 
distrT?r?perating budgets and capital expenditures. - Smaller classes increase 
the need for teachers as well as classrooms. Thus, at least as an order of 
magnitude approximation, the educational cost per pupil increases in 
proportion to the teacher-student ratio. Reducing class sizes by 10 percent 
means the cost of education will increase by a percentage approximating 

10 P^^^^gJ^.^g^ggs^. substantial body of research on class size establishes 
that " it " IS related to student learning. The many studies on this topic were 
Integrated through meta-analysis by Glas& et al., and the results reported in 

book entitled. School Class Size .^^ Although learning is correlated 
with class size, within the range of class size typically found^ in American 
schools one would not expect from this meta-analysis of research hat r^^^^ 
the average class size in a school district from, say, 30 to 27 (10 percent) 
would result in a substantial increase in learning. Its impact would be low. 

/ b Mast ery learning . This intervention consists of implementing the 
in'structional approach commonly referred, to as mastery learning. It . _ ^ 
. included here as 'an example of a substantial number of instructional Practices 
which could be adopteaTTHough mastery learning has been-5hawn_to_,b.e more ^ 
effective than, most new instructional approaches in terms of student learning. 
Among its characteristics are well defined, specific instructional outcomes 
instruction focused upon these objectives, and reteaching ^l^^i such tim^ as 
the student has acquired the desired outcomes. The rate at wh ch a student 
proceeds is deterrtiined by the time it takes for him or her to 'master the • 
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objectives. Among the characteristics of this instructional approach are 
frequent testing and immediate feedback to the students. Similar 
instructional approaches sometimes are found under different names such, as the 

Keller plan. . . , ^- i , tu^ 

•Cost: The costs for implementing this approach are relatively low. The 
most TigFificant costs are teacher training in this instructional approach and 
iupport from knowledgable supervisbrs in implementing the process. 

Effe ctiveness : Research shows this instructional approach to be very 
effective, in a meta-analysis of research' on different instructional systems 
used in science education, this approach stood .out among others under 
consideration. Students in experimental classes using this approach had an 
average performance on cognitive achievement tests equivalent to studeg^s at 
the 69th percentile in the control groups to which they were compared. The 
effectTveness is significant, and the costs are low. There are indications 
from other research, however, that the benefits of this approach are due to a 
larger amount of time devoted to learning by students. Thus, the benefits of 
this technique may be obtainable by other approaches which result in greater 
student "engaged time." 

c. Computer-assisted instruction . This intervention includes,all the 
various approaches to learning with the assistance of . a cdmp.uter, such as 
computer-managed instruction, computer-assisted instruc^ionjandj^th^s^^ Tt^-- _ 
mUTt~b~e different iatTd, however, from instruction aibout the computer or how to 
use it. In the Tatter case, students are learning about- the computer vtself 
or how to^ use it for any of a wide variety c'f purposes other than education 
itself./ In the former case, the one of intei*est here, thejcomputer is simply 
a vehicle to assist in learning any of tfre subjects in the icurriculum-rin this 

case,/science. , . . ' 4. r \u 

/Cost : The costs of this form of instruction are high. The cost of the 
equipminT is substantival and the cost of developing the software needed for 
instructional purposes is high. At the present time, there is a serious lack 
of quaVity software for teaching science. • i. j 

Effectiveness : Studies of the effectiveness of computer-as^^sted 
instruction in scTence mostly have not yielded dramatic results. Student 
learning is essentially equivalent to that in traditional classes. So for the 
short term, this intervention is not very encouraging. Costs are high and 
learning could be expected to stay about the same rather than improve. For 
the long term, computer-assisted instruction may have much more .potential . 
Examples of computer-assis'te'd instruction can be found iri certain settings 
with certain materials that are quite effective. There currently is much ' 
activity in this realm but how long if will take for this intervention to 
become, cost-effective is still a matter of speculation. ' . . > 

In- summary, improved instructional practices are interventions with a 
wide range of potential in terms of their cost effectiveness. Although most 
of these possible interventions have not been specifically analyzed here, 
information has been provided illustrating that there are instructional 
approaches with the pote of being quite effective. ' It may be one of the 
more fruitful areas for seeking greater quality of teaching.. 
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4. Inserv.ice Educati ng of Teachers 

This category of interventions encompasses education inten'ded to improve 

^-ir 1 H Ib^nJ^^nfp^es^ 

J^sfrrife instruction or ^"--^5^ ^^-.J^j-.-^fet e ° of? ^f rms of 

JfffereSt types and thus will be treated separately here. 

a' sii— ^"-^^^"^^ ^ fnr science teachers . This intervention includes 
the "t^st l Ses " operated during Lt .e sui.ne, by the National Science Foundation 
^M^F/Surina recent decades. Focused mainly 'on science knowledge with only 
SiS att^nUon tSV^^ issues, they were intended to upgrade the 

""'irs't- °lnrtlrures'o?'Jhil*nature were operated by institutions of higher 
Cost, ijsj^"^^^ ° cuDDort from the federal government. An additional 

Sis eS?^ 

riipa?i^jj ^^^^^^^^ - 

thoScht them to'be valuable! Empirical studies of institutes. in a variety of 
^ptJinas however did n much evidence of positive impacts on the 

settings, nowever, uiu g«j 35 i-hprp wprp- even evidences of a negative 

qu-a-Hty of instruction. ^" -L^^* * k ai i f niH wp have essential ly 

Z the S", are effective in improving the quality of .nstruction ,n the 
schools. 

■ ^ h Aradpmic vear ■ full-time institutes f or science teachers. This 
intervent i on SsiIts Vinserv.ce education activities s.m. la. to the summer 

'^"^^^^"os.r 1^hricfde^?r5eriS^st^rutrs^:er^"dnJont.inued earlier thah the, 
^;Ht-..?pr Thus direct cost information based on experience with^ > 

Th^wo d a e to be adjus ^d for inflation. Basically, however, the costs 
■ on a Tr person, per unit-time basis are the same as the .sutler institutes.. 

?he loss Sf sa, ary%or the teacher is large, of course, even, though these 
: Institatefcarried a S2,70 All told, it is a high- cost , 

r^^'^'pE^^^^^^ the.effectiveness33f academic. year institutes^js 

.ore posfJve than cited for summer insti tutes.^^ above but to a large extent- 
their impact is unknown-. • . ■ 

r ■■TncH>..tp rias ses" conducted ih the late afternoon or evening dufinc 
the schoo l year Sponsored by.Ll ie same funding agency, b ut ottereQ on a par.: 
• time basis in t he late afternoon or evening while the teacher is fully 

. 47 ■ ^ ' •• 
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employed, these activities have provided essentially the same type of 
inctyiirtinn as other forms of NSF institutes. ' ^, ^ • ■ 

Colt- The coft of the Instruction itself Is about the-same as that • 
„,.„i^in the summer oroarams. Because no teacher stipends were provided 
r San«%ruese'dUes typicaUy does not 

'''''^i.^^^iJi^rl^'^'^ J:^:^ than that cited above, 
for the other types ori^institutes." 

d. Tncorvi>-p Pducation courses on the appl ications'of science. This 
intervent on isHnservice education classes on the applications or science. 

e science useful in add^ressing personal needs of students or societa 
ksues It is the first of three- interventions listed here which address 

'^'^'''i^ ^rhfs^e^de^'oV is°^oi°?n";st. The cost Js estimated from the - 
tiiiti^osts of continuing education courses in which tuition covers the 
to a Jost o^edu"atio^ 'This cost-sometimes is P^id .J^ ^^e teacher and in , 
other case's by the employing school district. An additional cost.to the 
school district would result, if academic credit moved the teacher up, on the - 

._sa-lar|. schedijle.^^^^ = 
curri culum and th ' e extent to which 'greater emphasis is sought in. the _ . 

• c Hculu:?or the appl ications of .science. If ^J^^riS^ t%rpW m 
rurriculum the Content of such an inservice class wou d^not apply very ^ 
directly to a school system. In this c=ase,--a substantial impact upon^teaching 
andMea?ninq is not liLly. On the other hand, if changes, are ^eing sought ^ 
with respect o Sb ective #3, Appropriateness, to give greater Jei^Rhasis^to the 

Ob ective #3? This point will be addressed-f arther in connection with \ 
interventions for objective #3, Appropriateness. . 

e Tncprvir.P educ ation classed focused on more advanced levels of 
science. : The purpose of- this endeavor is to give teachers e/Q^^;^!^, . „ - 
!^al?ifand nq of their teaching- fie.ld. The :cl asses would provide information 

variourasDects of science, and ^nove tWvteachers .beyond their current 
knowledge! This instruction would be- similar to that provided under the 
institutes described in 4..a., 4. b., land 4.c, above, 
institutes a«cr would be the sW as. the previous intervention 

m?ctivenes° Information ^prLented earl ier indicated a low but . 

S "di nr:!t:?si'j?^ 

?o aVeach^r's effectiveness. So.ytudies have ,s o„„ for e am^^^^ 



i-p;,rhpr'^ knowledge of the particular science. There are additional • 
considerations however, siSce science is a rapidly changing field and a 
^facher's p?eviousircur.rent knowledge can become outdated in a matter of 
lea^s -ThSs some amount of inservice training or other means of learning is 
^ecrs;ary for a teacher to maintain an accurate and up-to-date understanding 
Sf the field. There are, other dimensions-nbt always evident in tests of • 
student knowledge. Several observers have noted, for example, that an 
stuaent Mm . a crience courses is to eliminate some of the 

So c t ud t V 'Ib'ut basic'phenomena and avoid introducing new 

• S^Infnn^ There is evidence suggesting that the absence of such 

e on ^s' ^p ri nr or"ude^?s if ?hey are to "be successful in^more 
advanced 1 eve s of science. For these two reasons, one ^^/cautioned to not 
auickly dismiss the importance of science knowledge .beyond what w 11 be 
Sred n the initial 16 to 20 hours of college instruction in the field. 
Stiir there is not strong empirical evidence to support the effectiveness.of 
a large amount of advanced training in .a given science field. 

f Tn.Prv ir.P education Classes o n teachin.^ methods. ' This intervention 
consists of inservice education classe s addressing various aspects of teaching 
methodo ogy and instructional practice. Specific pedagogical topics could 'be 
^nv nf a larqe number including- those mentioned Earlier, such a^ how to employ 
Tastfry learning ahd how to increase the amount ^of time in which students are . 
.^actively^ngaged^in^l^^ interve^ion arAhe same as those ^de,.cri bed in 

"^^Ef fectiveness: The effectiveness 'of this- intervention must be evaluated 
both as a s nqle - l ntervention and as, part of a larger multifaceted^endeavor to 

u ?nstr2ctioSa? change. The evidence on ^heeffectivenesso single 
isolated inservice education courses is not strong. . On the .other hand 
ihservfce education may be ah. essenMal element in an overaia prpcess of 
. rplementing change. In fact, some objectives, such as changing selected 
eachfn pracUces or changing some aspect of ^^e curriculum may^ e^qu te „ 
r^mhipx and involve'several interventions, one or more of which, such ?s 
nse Vic edrat on, may b^^ important. Research on .t e; process of 

^Dlementing educat onal chahge provides support for -the proposition -that^ 
ZerviSe education may be an endeavor which by itsel.T is of minor value but. - 
■ a^olSer coStex? is one of the foundational b-uilding blocks of a..successful 
Process of change. It is yet another "example of the; systemic^nature of the • 
. sUuation. a ?opic to be Jdressed again in^a latepsect-.on-^f this report. 

a Tn^PrvirP. educa tion program cojrdiin4ted ' wUh local development 
GostZ-iS^st of this formV-lnsenvice^e Usywould be ,essenti.>11y the 
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program improvement is. such that its effectiveness can only be judged in that 

context. ; 

h TPacher rar^^ar^ vih P.rP. teachers can work toget her on program ^ 
h. jeacner . 1 i inseTvke educ at on class|rr^This 

intervention al.o IS ^^latea to a d o ^g.^ers sometimes are largely 

fnre:°rco:rrrff rea^h^rf 5hems"vL-^nd provide inservice education the 

'^"tost'^'Arain" co^f or^hrinse^'c; education itself is essentially 
the si?r;s i^diclted in d above, with some additional expenditures for ■ 

^^^^iJ/ertilrfs- °U°is"dirffcSu ^rprovfdrrrsure of the effectiveness 
of thrrftiF^fn^ducrtio^ itself in' that its potential . mpact argely 
a resuU of lis relationship to other program development work being conducted 
simultaneously. 

i PvtonHoH v par contracts for teachers for program develop ment work. 
ThP hl;ic feature of this intervention is to emp loy teachers tor an adoitional 
lie? i'flllJr befond the standard teaching year to develop new curriculum 

^^'^'l^.'^^^^^^^'^^ ?ri!:ra TrS^ated extension of the 

. „S!p! afjlvc ribed earlier; it also has some potential tor increasing 
. ?^e\5lu" o^ e uJa oS direct, US "^^ f^^-^;;^:^^::'., 

active teacher cooperation in the process. 

' ' i T-r-"'-^ ^'-^^^^'-'- evaluation as a basis for professional f ^"-^ 

"""Tost ■'•the cost of this i«er,e.tioT%--<RscH6ed •»» connection with the . 
-*';??!:;reners!'°Jijue1^;rril5;nnrt;ailL!; irtSr^Jtectiveness Of , 
this intervention as the basis for inservice education-. - 

k c.hh. Hr.l VlPaves for the pro fessional growth °V^^y:;- ■ ^" ^^^^ 
ThP S^tilit^es can take on many forms (generally with the approval of the 

^'^''cosf The cost of this intervention is basically the cost of ^ ^eache^'^ 

_:M|4i_Ji^i--i^i*;:^^ This cgsj. 
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5. Tmnrnvyinq Sci fince Mater 1 a1 s . ■ 
Equipment and l-'aci lUiBj, 

,„ contrast to other categories °';"""t",51°"?;,l?i^rs%irlSJtp.rnl' 

°"^nre roJ^sn:ire"insru ^i^ir;:! "^rois^l^Vhf^^ 

available for science ^"^'r^";'.^ ria<;<;rnoms- most are paper products 
'?,rrr?SI?e^arra"ru s an . I" 

category.. Equipment refers durable materials with a re a^ are Bunsen 
^Srne?:!^lrssr^rrnrrect?lcir:rt^rl: °rJJ^t"es ^e^er tS the -furniture 

"cS "^^eter^i^g ^"^^^^^^^ V^n of this low cost 
,,nter^ion°pr s in/J-^ - - ^'^ ^ a ^ 1 tiurofluch 

,™?:r?inhr= 

science program indicate that the fe^^Qe cobt " « ^^ student per year. A 

i'stems for six to.seven Years before ^ ^y^f^^e^? s hool^ s'^ mlllhat- 
condition of "materials, equipment and fac litiesi^ ^ supervisors 
diff1cult-,-to-determin.e._Corwexsati^^ 

lead to the conclusion that "'^"y* ^1^^°" .J "fu.f.^l '^^^^^^^^^ The sar^e c^uld be 
• of the basic equipment they "^^d ^° "J^^f ^^^'^^^ geg?ee The major 
said of consumable supplies, although to * lesser degree. 

senior high schools, seem to have most of ^^e Jac^in^p^. ^U a general, base 
conducting a. good science program Mpre would be h^ 
of adequacy in this ^^gard is fa rly common Al o^^^ 

costs rests on the ^ssuyt on that the current program w ^ , , 
i.e., the number ^tudents taking scien.ce course will "° P. ^^"these 
curric lum will not be c anged 1 any^^^^^^^^^ 

assumptions ^onot^hold true i.e.,. r ^^.^ appropriate . 

students expands and the curriculum is "jo^' ^ , ^ necessary in 

for all students, additionarcosts wo" J^f^ ^e^^^^^^y 

provide reat hope » ,f „ ^ f.^^Tat Hals, equfpment and , 

'a major way simply by . ^"^"^^ tho' status of these resources , in the 
facilities. This conclusi.on ed^^" J^^^ res-e^rch basis for saying'that a 

schools . as d"^^;^^^,,^ rals'and u men i m rtaUt for improving 'science 
greater ^"'f " ^^^^f f.Jk^^fTata^^n^^^^^ substantiaWy increased learning 

^''^S';!^;u from p?o fding mo?e of these materials. • Also, providing 
would result trom prov lu iny '"''^ ^ *.ug^ ^ill used. The 

'^r'u' New Tc\tcl p og als initiated .in the 1960s and 1970s used a 
country.' Bataava^^able today indicate that In many of these cases the 



equipment is. sitting largely unused. Thus, there \is some empirical b^sis for 
spying that equipment is not the critical element \jn the system; it is not the 

determining factor. \ ^. \-' *. «.u« ' 

" This analysis concerning effectiveness rests on the assumption that the 
curriculum will not change significantly. The situation obviously is 
systemic, however, and major attempts to improve the curriculum of the schools 
may result in a need for different 'materials and equipment than the schools 
currently use. Thus, rather than lo*oking at this intervention singly, it may 
be best to consider other .interventions, such as increased student 
requirements and a changed curriculum, as the more basic interventions with 
materials, equipment and faci 1 ities being only cost factors to account for in 
the cost-effectiveness analysis of these other interventions. 



6. Industrial Assistance 

This ^category of interventions includes several ways in which business 
and industry can assist in improving science education in the schools. They 
are of three general types: (1) donating money or equipment to assist the 
'^-schools in various^ ways, (2) donating the time of personnel to assist the 
' schools in some "'manner, and (3) offering eniployment to teachers during non- 
' /teaching times. Specific interventions in each of the three groups are 
/. \ /discussed below. Many of these. interventions are low cost but the cost to a 

• ^ -S particular industry may be quite high relative to their budgets if they were 

/ to' initiate them for a substantial, number of teachers. 

■ ' ■ . ■ . . • 

a"' providing seed money for educational projects . The intent is for 
business or industry to provide a certain amount ot "seed money" for 
initiating special educational projects not easily f unded,;from^the^regular » 
School budget. Such projects may be, experimental in nature but with the 
Potential, of liecoming permanent school activities if they prove successful in 

Vtheir experimental form. \ , , , ^. i. r u 

i Cost- The cost basically is determined by the amount of such assistancef 
Vovi^ear It could be very small or quite large. In addition, if projects oi 
^^his nature are chosen competitiv^ely, ithe administrative costs of selecting 
S a'nd monitoring projects will be involved. , . ^ „ 

\ .V Effectiveness: Determining the effectiveness of this intervention is 
viry difficult since it depends upon the purpose to which the funds are put. 
T^te results of t\\e cost-effectiveness analysis of the many interventions 
addressed in' thii, report make it quite 'clear some interventions have^ 
coiisiderable potWtial and others very little.- The same in all likelihood, 
trile of whatever\activities would be supported through; this intervention, 
bastic question of\ the purpose to which t^he money will be put is largely 
. unanswered hefe. \ . ' ' 

\ bV Providind cash awards for individually deter mined. programs of 
ner^onal and professional development wh ich are sponsored by ana named f O'" 
pariicMiaiL^Susiry . I he ini enjloi. this int jn^ enxion is. to_provi^^^^ 
support programs JTpers-onal and professional development for ijactiers. The 
nature of the activities may resemble some of those described in the section 
on Enhancing Teaching As a Career or Inservice Education; the specific 
"activities will be determined on an individual teacher basis. 
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Cost: A program of this nature could be establ ished at many levels. The ^ 
most expensive form would require funding for teachers' salaries while absent 
from teaching duties as with sabbatical leaves described previously; others 
would be more modest. Along with salaries would be the co^t of the 
■ professional growth activities themselves. The cost of such activities, also 
is highly variable but could easily reach $5,000 over a period of an academic 
■year if it involved considerable travel and highly specialized training. 

Effectiveness ; The effectiveness of this endeavor likewise is very 
difficult to determine because it is highly dependent on the nature of the 
specific activities, and by definition these activities can. vary widely. In 
keeping with the systemic nature of the situation and the analysis of other 
interventions, it can be said that generally the most effective interventions 
are tied to some other positive action and are not done in isolation. The 
question of effectiveness must be addressed individual by individual; 
information on the potential of ^many specific actions by individuals can be 
acquired from the cost-effectiveness analysis of other interventions in this 
report. 

c. -. Equipment donations to schools by industry . On occasion, business 
and industry have obsolete or unneeded equipment which they are willing to 
donate- to the schools. To whatever extent such equipment is useful for 
instructional purposes, these donations can be an asset to the schools. 

Cost: _There are two basic costs to this endeavor". One is the cost to 
industirirof' donating this equipment, the salvage value of the equipment. A 
second cost is a loss to the public of tax revenues when the industry "writes 
off" th4 sal vaae- value of the equipment as a tax deduction. 
. ' - Effectiveness. Interviews with science supervisors in the state of 
Colorado do not provide^strong evidence for the effectiveness of this : 
Intervention. The common opinion, based upon past experience, is that most- of 
the equipment received in this manner is not particularly useful. Its 
original purpose was such that it does not have a lot of utility in the, 
classroom and 1n addition, this donated equipment often is in poor, condition. 
Such "donations, occasionally do result in schools receiving, equipment of 
substantial value to them. ' On balance, however, this intervention does not 
hdve much potential for making a 'mar'ked improvement in science teaching. 

.d. Bu siness and industry loaning lecturers or workshop leaders to 
scTiools This intervention is the tirst of , three that provides the time of 
business personnel to the schools free of charge. Its intent is to provide 
the needed expertise in selected important areas. 

Cost : The cost' of this endeavor is basically the salary, benefits and, 
support~costs of maintaining the employee, prorated over the period of time 
this person is involved in the schools. 

Effectiveness^. Since lectures and workshops' vary dramatically in quality. 
and purpose, it is difficult to evaluate the effectiveness .of this particular 
intervention. A reasonable maximum benefit one might. anticipate is the 
• fjiaximum benefit occurring from Inservlce teacher education. In addition, 

artivities for students have the potential for aiding their learning if the 

topics are well chosen, the content is coordinated with other parts of the 
curriculum, "and the personnel are conscientious about the task., 

e. . Rotating business and- industrial employees to^classroom teaching for 
certain- time periods. This" endeavor is intended to alleviate the shortage ot 
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temporary basis and prov. e qua y | J- differrnMal in pay 

Cost: The existing saUry o'f the employee from 

between a teacher's salary »™ the existing s?j^ business would cover 

industry. Under °r "'^^u i^e^s wo J^ - 

Z .fX^'^^rT^^^ 5i:o?arf"e'a'sho?Ug %hat cannot be replaced at a 

?Z Ind do their instructional work within a context established by _ ^ 
professional teachers • ^i. 

competences. „ouTd be the salary, benefits and support >, 

ser,iil^prol?de"?or"tr,e:plJJee in his/her position in^ industry. It is a ^ 

'??lc;ivrnen-°"the effectless of this intervention is related more to 
objeclr^FCTopri f ness t^ j^e'^xJe^t" f w Sch ? "fi ^ied on 
Evaluating the curricylum^to "^.^J'.^'fj'f.JScial taslc and> requires th6 

the most aPP"P':'f=,,""4f* of peSjte rom «nj segments of society. - Studies 

personnel from ^"dustry as well as the viewpoint^ democratic process 

variety of other^segments orsociety, are ^^J^J^ J^g.^ ^his intervention . 
: of determining what^shou d be U^^^^^^ ,3 of value for 

SS^jJlSeY™^^^^ the^rrlculum. • 

months, in. the summer. The purpos_^ 
teaQjiers ^o'^^^P^^'°°°- career by providing additional employment, and 
to e^.hance. teaching as^ Unemployment faced by, most teacheri 

. rem(|ving the P2;]PJ^^°° JL^ intervention viill provide them with experienc* 
trl^^ience-reS^inSS;^ ^eUillg^wMch wil/enable them to be better ; 
•teacKer?! of scieftce and technology.. ■ • ; 
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Pn^t-' To whatever extent science teachers can step into positions which 
indusTTTneeds Jo ft 1 on a temporary basis, and, do so without substantia 
tJainS this intervention would have not cost. In rea ity. the training 
reaiired'for most industrial positions and the infeasibil ity of employing 
someone only for short periods of time arbitrarily determined by the school 
TaTlndi il such that thefe would be costs involved. In most cases fi ling 
position; n this manner would not be the optimum approach and some additional 
•?n^K would be incurred by business, although these costs could vary 
sub^tan? lly f om one setting to another. It is possible that some year- 
arou d itions which are vacated extensively d^r ng the ^""^^^n^^""/^ ° , 
vacations taken by the regular employees could be filled on a temporary basis 
htf tpachers. On average, it is a medium cost intervention. 
^ Effectiveness' Although difficult to define in specific terms, it 
aooe afs this inter vention, if it could be implemented, would be of 
considerable benefit to science teachers .and the teathing of science in the 
"hools t has the benefit of enKancing teaching as a career by elimina ing 
the forced unemployment faced by mo'st teachers for nearly one-fourth of the 
year The employment that most teachers are able to find for this per od of 
time usually does not require the scientific or educational skills of their 
professio A further benefit of this intervention is the professional growth 
Sf the teachers involved; it potentUlly could provide them- a setting, in, which 
fhey would learn an extensive amount about the applications of science, how 
technology nfluences our society, and some of the career options open to 



students. 



C. Interventions to Attain ' 
Objective #3: Appropriateness 

The third objective, appropriateness, brings us dir;ectly to one: category 
of .in-teri^^nldmuJiM^^ school curriculum. The^existing 

Jesrar^Tresim^^ are informatlwr-i^^^tT^ r^^ ,fl^ 

o?tahli5hes auite clearly that the science curriculum in the schools of this 
c^untiy s de? ed by the textbooks in- use; teachers teach whatever is in he 
Tex Sooks! Choices are often made ^^o^^mong what is con aine in e oo 
bPrause it contains more than what can be covered3^n a particular course, oyt 
rarelv i a s dnificant amount of materia-1 added. Secondly, the widely used 
textbooks in this country give little attention to the. processes of sc ence or 
thf appl cation of scie^ce;^science.related personal needs or societal issue 
Jece e itt e at?ention. Based on reviewing several studies, i appears hat 
a good estimate of the average amount of science class tj§e3gevoedo these 
applications of scientific knowledge is about 5 percent. , ^^^cience 
basicallv is viewed as important for preparing for the next level of 
.rhonl na not because it has seme direct value in and of itself or for other 

1? "tfon^of^rhe^knowledge.^^ These rather ^trojg statements have a c ear- 
cut research base; they are based on observations of the real world. It is 
within the context of this reality that questions concerning the curriculum 
must be addressed. They involve a substantial number of value judgments 

■ althouah there is a substantial amount of empirical research information that. 

■ mi be cons^de ed i making these judgments. Without careful attention to 
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the empirical research, it is easy to adopt value judgments which are based 
upon erroneous conventional wisdom. 

improving the School Curriculum • 

This group of interventions, the only, one addressing the app^^^^^^^ 

curr,2uU. are C Josf co^ared to the ■■q.alU," interventions described ,n 
the previous section, 

aPP'^"'i-! )ZlT¥M.'l rllTr arbitrary number 



jf^rter'in a' s;.e; -different context. ™ -^J^;^-^^^^^^ 

-d^tS: %n%\..U. would be 

''"'iost^ '^^^V'' SrtieSS?iI"\"oc"^;fe^ero;:fcS2"e-recent,y 
Inexpei^TTve examples J^"*i^'f^;.J'°TeacLrrAssfcia^ yet was 

received an award froij the Njt'""^ /J^f "J^^fl^J^on County Schools' Topics 

developing a new cu'"'"iculum package. ^^^^^^^ ^^^^^ 

fhrs irpncrtiS ;?:^:s : S^^^ 

a detailed argument in t'''%'^JSf J- ^^^^Vhich we live today; it is 
,t begins "? r^J't ^KnXo c " nature! "any personal needs of 

increasingly scientific ano ^ecnnoiuy ^ . < .^o knowledge and our 
people cannot be addressed J^^f^J^'^^^J^f ^Sich Jan"ot be add?essed adequately 
society faces many s':^?""-'^?^"?" '""^Ls aroument goes a step further and 
without substantial science Knowledge. .I^S'^'^f^J' f f= ^ students do 
is based upon what research says about f ^"f J„,i=?„ abstract.in 
not automatically transfer "^e^^f "4"°", °^e ea situations noted 

conventional fj=/„=to' pplfs e w^ed e^'tS'leeUng personal needs and , 
?5en?;fyII;/oJuml so?S?lJns%o science-r.l ated societal problems by 

^^-'irt?e'Sj^,urnre^p?;st^sH:?hrabr ; ^i^'^^:'^:ir' 

leaders and educated P"P|f;5„°JS,^2S; J;, \ 'sSols! It IHn . • 
Crun? :2elt1orard':o'ni;;Sf'5tresriSg sl-ightly fro* the agenda at hand 



56 



53 .. 

to aain some perspective. Surveys of teacher opinion, for example, show that 
teachers generally do agree with this argument; they sa^ that the applications 
of science are important. In practice, as noted earlier it is not a . . 
siqnificant part of their teaching. When pressed to explain why they do not 
•include it more in. their teaching or why theydo not choose textbooks that 
qive it more attention, teachers will respond that they. do not have enough 
time because there are so many parts of this body of science knowledge they 
must teach students so they will be ready for the next level of schooling be 
That senior high, college or whatever. Research shows that this is the strong 
opinion of the v^st majority of teachers. ^he other hand research a so 
shows that the science knowledge learned at one level of schooling generally 
is 'not critical for the next level of schooling. For, example, numerous 
stulr^s have shown that having or not having taken chemistry in high^gchooL. is 
not a significant predictor of student success in college chemistry. _ 
AJTother example: medical schools which in recent. years have changed their . 
•entrance requirements to admit students without a strong science background, 
in addition to other students .who do have, the science backgrougj, are finding 
that both types of students do equally well in medical school. Research 
shows quite clearly that the preparation notion is strongly held and it also 
shows there is little empirical basis for it. Teachers do not have to spend 
"aTroTtheir time teaching the body of scientific knowledge in the abstract 
IKS in isolation from other considerations. Research offers no reason to 
resist shifting from the current 5 percent of class time devoted to the 
applications of science to some higher percentage, say 25 percent, or even 
more There is no reason of substance for avoiding numerous topics which 
currently are seriously neglected in the curriculum because of the perceived 
need to prepare for the next level of schooling by learning the largest ■ 
possible amount of abstract knowledge. Among the avoided topics which could 
be given attention are how scientific knowledge applies to personal needs, how 
scientific knowledge applies to a wide variety of ^o^^eta issues the 
processes by which scientific knowledge is acquired, something about the rea 
life struggles of researchers, information about the limitations of scientific 
knowledge, problem solving and decision making in a scientific context, and 
how to think and learn on one's own outside the classro om. 

b nPVPloDinq more rigorous science courses for c ol leqe-bound students. 
The intent of this intervention is to develop new courses and instructional - 
materials having a more advanced level of science knowledge than current 
advanced courses taught in U.S. senior high schools. They would be in 
addition to. or in replacement of, current college-oriented physics and 
chemistry courses common to almost all school districts and the second year 
advanced placement courses in biology, chemistry and physics found in some 

senior high schools. ^, \ ^ j i ^ , 

Cost- As in the case af intervention a above, the costs of developing a 
coursTHr'this nature vary dramatically from relatively inexpensive to very 
exoensive To a large extent such course materials do exist, however, and the 
cost involved is not so much for developing the materials as it is installing 

them in the schools'. . ^ .• . • ^ i.- • 

Effectiveness- The question of effectiveness of this intervention is 
■ again a value judgment about appropriateness. Two factors derived from 
empirical research are relevant to this issue. One is the previously cited 
research indicating that taking the current col lege preparatory science 
courses in high school is not 'a sign-ificant predictor of success in college 
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science courses. Based on the results of this research there seems to be 
liitle reason to think that more of the same would lead to more success in 

"^^Tcon^non interpretation of current research is that the top approximately- 
5 oercentTf students in the U.S. perform equally as well as the top 5 percent 
of stSdents In Japan and other highly developed countries. The same cannot be- 
said of other students in U.S. schools; the typical . Japanese student other 
thl' the top 5 percent, performs better than U.S. students. This information 
indicates that the major need is not to have even more rigorous work for the 
iprv too ability students but the need is to provide better science 
rsLction fir s Sents of all levels of ability. '"f^nt study conduc ed 
bj the oJfice of Economic Research .pf the New York Sfock E'^change -identified 
the high quality of primary. and secondary education in J^gan as the single 
most important factor in iVs high economic productivity. . .he 

This 'statement is not intended as arf , argument against an increase in the 
quality of instruction wherever possible in all types of science cour e The 
noint Of this argument is simply that developing more rigorous courses (i.e., 
?haSging th^'cur^iculum in this regard) is not an- effective move for making 
the curriculum in U.S. schools more appropriate for its students. 

c: °<^H,. rinn thp n.imb,.r of "frill" cours es-. This intervention is often 
espous^d.-but usilally without spec |ly ...g whaL Irill ""'"S" f ^^^^ "J* 
' rnnrQP.; SO identified typically are not science courses. The usual targets, 
; "^nes'c'o^^iy co^^idereJ less "academic." With jespect to e saence 
riirrirulum this intervention n practice turns ouc to be essential y ine same 
a^one a S^e ed earlier in this report, namely increasing the required number 
of ?Surses in science. If the number of required science courses is - 
increase hee s "e s room in a student's program for other courses whether 
Jhey be "frill" courses or substantial courses in some area other than 
science Thus the cost-effectiveness analysis of this particular 
i er e^tiJn is esLntially the. same as. for the earlier ™n ^^^^^^^^^^^^^^ 
increasinq the graduation requirements in science. The reader r^rerrea 
back ?o that po?tion of this report (#A.a.) for further consideration of this 
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d. FoHpr.l funding of new curri culum development proiects. The intent 
is to us e federal funding to esL db lish new curricu lum development projects 
patterned after the NSF-funded projects of the past quarter century. The 
nSroose woSld be to develop new curriculum materials to meet current needs. ^ 
purpose would De P ^^^^ ^^^^^ ^^^^.^^ ^^^.f^iii^'" h 

projeHl:' these new endeavo^^ are estimated to cost between $500,000 and 

^^'""^ fgeaWenesL '^Re^ea^ch has established that the curriculum development 
Droie cts of the pa st generation were successful, in two senses. In terms of, 
? 2 el arn?ng'on cognitive measures, and a variety of measures o other 
student attainment, such as laboratory skills ^"J "jdfj^,^"^^"^,^?' ^ were 
methodology of science, empirical research shows that the new curricula were 
more s2c?eLf^ than the "traditional" curricula they replaced. A stat stical 
inteqration of the results of over 100 comparative studies shows that the 
lleraqe stSdent in the new curricula performed at approximately the 62 
neSile of the students in the control groups. These research results 
S o St dies including over 45.000 students ^^^^^^r^:/ J 

in their results.. The new curricula also were successful in another sense. 
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the content was different from the traditional curricula they replaced. 
Furthermore, many of the textbooks produced by the major commercial publishers 
changed in content over time to be more like the new NSF-funded projects. The 
new curricula made a new content available and influenced the major textbooks 
appearing in subsequent years. In conclusion, there is strong evidence to ^ 
indicate that new curriculum materials could be developed 'which would be . 
successful witK students and would .have a new content emphasis in keeping with 
the important goals espoused for tomorrow's students. 

e Revising the "old" NSF science curricula by expanding them or 
r^^nlArino onrti ons with locally developed materials . The intent is to. develop 
new curr i cula but to d o it on a smaller scale. (Essentially, it would be 
taking the NSF-developed curriculum materials of the past generation and 
modifying them in accordance with current goals of science instruction. This 
approach assumes the extant NSF materials have many good portions but could be 
improved by. major modification. . . ■, • i. 
Cost- The cost of the projects for modifying extant curriculum materials 
■ shoulTTe'considerably less than the full-scale curriculum development 
projects cited earlier. Costs would var:y substantially depending upon the 
extent of the modifications, but an arbitrary figure useful for general 
planning pTirpoler"cmjrd~b-e^rie^th-j nj-^ro-or^^^^^ 

endeavor. - ^ ^..^ • 4.-^ ^ ft,« 

Effecti veness : If the assumption is correct that major portions of the 
existing N§P curriculum project can stand as they are. and if one further 
assumes that the successful past experiences of developing materials can be 
repeated with a new emphasis, there is every reason to think new projects 
could be successful in developing materials which match current objecti ve.5., . 
such as those'- emphasizing applications of science. 

f ' providing training for local school districts on how to develop and 
implement-cT Trricula . This intervention will provide training for local school 
district leaders on developing new curriculum materials at the local level and 

■ introducing them to classes in these districts.. _ ^ • • 

Cost- If one assumes that this particular intervention involves training 
only anTnot the funds for the development and implementation work following 
the training, the costs are not forbidding, though, s.ubstanti al . Assuming that 
'—th'is training is provided for one educational leader from each of the 181 
school vdistricts in Colorado, with the exception of the 20 largest districts 
where an average of 3 persons per district would be trained, the total number 
of trained people would be 221. If one further assumes the scope of this ■ 
training is equi valent . to six semester-hours of course work, the cost would be 
calculated on the same basis as for inservice education classes described 

previously. , ^ ^ • i „ " 

Effec tiveness : Based upon the results of research on curriculum 
development and implementation activities during the past couple of decades, 
it appears the effectiveness of this approach would vary substantially 
depending upon the aspect under consideration. The curriculum ma.terials 
development aspect is considerably more complex than the implementation 
aspect — Based on information about the skills used in curr.iculum 
' development*^' and knowledge of 'the qualifications of personnel in smal er 
school districts, it appears unrealistic^ to expect significant materials 

■ development in smaller school districts. On the other hand^.in some of the 

' larger districts with personnel having the required training and experience, a 
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certain amount of materials development is a feasible expectation. 
Implementation of new curricula, on the other^ hand, is not only feasible but ,, 
required in even the smal lest districts if positive curricular change is to 
result In this regard, it is well to note that research establishes the 
imoortance.of local initiative and commitment if suph change endeavors are to 
succeed. ChangTefTdeavors imposed from outside the district by either a 
"carrot" or "stick" approach are. not likely to be successful. 

g. Establishing regional consortia of schoo ls and universities to 
develop curr icula . The intent is to establish consortia of school districts . 
and universities to develop new curriculum materials and put them into 
practice. Between the schools and the universities, the full range of 
exoertise required for successful curriculum development should be available. 
It is further assumed that" consortia of this nature, focused upon a particular 
' region can tiave the close links with member schools necessary for developing 
materials wHich fit the needs of the schools and a're realistic for 
imblementinj under the specific local cond.itions. 

■ I Cost- Like the curriculum revision endeavors described in e above, this 
approacTT'to curriculum development and implementation appears less costly than 

fuU^cale-jQU rj-AfOMm development projects. Some_.MIltiorLoi' sthool .district — 

DffSonnel time already is devoted to curriculum improvement. To whatever 
extent this personnel time could be utilized more effectively under the 

• auspices of the consort.lum, it would not be a new cost but simply greater 
productivity from current expenditures. Additional funds would still be 

^ necessary, however, from federal grants, state funds, or contributions of 

^""^ffectiveness-.'^^Research on the federally funded curriculum development ' 
ende avors of the p ast quarter century indicates the development work itself 
generally was quite successful but the . implementation of these programs in 
. school systems frequently fell short. This research and other research on 
.implementing change in schools points up the importance of local initiative 
and "ownership" as well as the need for a variety of specific tactics 
requiring intensive and extensive local school district participation. If the 
consortium under consideration here has the high quality personnel 
characteristic of past curriculum development endeavors, extensive 

• participation and control on the part of local school districts, and 
sufficient resources for putting the programs into effect, there is . _ 
cons iderabl e reason for opt imi sm about its effectiveness. 

h States or groups of states setting new standards for adopting 
textbooks. The intent of this intervention is that states having statewide 
textbook 'adoption (or preferably a group of the major states) would establish 
new standards for textbook content. Rather than focusing simply on format, 
qraphics, and politically sensitive issues (e.g., evolution and creation) 
cotmion to recent textbook adoption committee proceedings, these. standards 
Would address the curriculum .content iss'ues noted in sections C.a. and C.b. 
' above. By insisting that the books contain certain materials before they . 
• would be adopted, the major commercial textbook publishers could be forced 
to produce new materials with different objectives. . cvicfinn 

Cost- The cost of this inter\ientron would be relatively small. Existing 
textb^^adoption committees already have a budget for meeting and _ _ 

• deliberating, as wel 1 as holding hearings to get opinions .from the public and 
professional educators. With a relatively modest increase in budget, they 

' '■ ! ■ - ■ ■ ■ 
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could collaborate with such groups 1n a few other key^^tates a d ^^!^^ve a a 
ioint aqreement on what they would announce ahead of time to Publishers as 
JeqSirements for new materials. The only add tional major cost would be the 
SeSeopmet costs incurred by the publishers in meeting he new standards. ■ 
Si^ce publishers already are devoting significant money to developing new 
materials.' a new orientation resulting from this process does not imply a 
significant increase in the cost of the textbooks when brought to the 
marketplace. Such additional costs would be a very low percentage of the cost 

°^ ^^EffeaWeness: Research has established that publi shying companies do 
respo nd btbe req uirements established by state textbook/adoption • ^ 
committees.*^ There is substantial evidence to support the proposition that ^ 
publishers would comply if several key states, such as California and^Texas 
Snited together to insist upon particular features of science textbooks before 
< considering them for adoption. Other curriculum development endeavors such as 
described in d and f, however, may be necessary before a state would have 
operational definitions of what th'ey want. 

i. npyplnoina model curriculum patterns for districts to consiider. The 
intent of "fhis intervention is that federal or state agencies, possibly in 
-roT)pBr^tTOTi~vri-ttr-profB^4ofva-l-a&socH-a-t-i-^ 

■frameworks for curriculum materials which^ could be used as- a basis for local 
school district development efforts. , • -i ^ 4. 

Cost- The scope and character of this development work is similar to 
that bribed in e above. Thus, the cost would be similar to e. The intent 
is to develop model portions of a curriculum rather than an entire curriculum. 

Effectiveness: The effectiveness of this intervention is based upon the 
assu mption that lo cal school districts actually would develop curriculum 
materials if models were available to them; Although some of this curriculum 
development work has occurred in few school sy5tems. across, the^country, the 
number is relatively small and thus the assumption seems somewh.at tenuous. 

1. Improving prog ram evaluation . The intent is that local school 
districts develop mbre thorough eva[u"at1ons of their curricu um programs. 
Some evaluation endeavors of this nature identify what actually Presented 
in th*^ classroom, what is intended by the pol icy makers who adopted the 
curriculum, and what content is included, in the district testing Programs 
^Se assump ion is that this evaluation will ident Ty discrepancies between 
what is desired, what is actually taught 4n the classroom, and what is.-tes^^^^^^^ 
This information potentially will aid decision makers in making better 
decisions about curriculum changes to be sought. 

Cost: The cost of such evaluation endeavors is low. 

E?Tectiveness- Little information is available on the effectiveness ot 
' this specific inter vention although evaluation is. a rather standard part of 
goal setting and planning, activities shown by research to be present in 
effective schools. - 
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D. Facilitating Interventions 



In addition to the interventions described above for attaining one,; or 
.ore J? j ^^h?ee specif i^^ here as ■; 

appropriateness, there are ^^ipj^J^^JJ^J^La" interventions are not focused in 

iSsentfir?itu?rereni before an'intervention has a high probability of. 
success? 

1. Improving Local Leadership 

:^Ia^etK^teSed to i and maintain changes identified in tfiF 



interventions above. 

;, Increasina the number of science supervisors wi thin local school 
. - ■ Tk! ntont nf this intervention is to inc rease the number of . 

Cos""?l!e'cost of this intervention is low/mediun, if oje «su™s that a 
distrm^iitJ lo.OOO students.has a science supervisor n th,s action calls 

'^Xr'i^^^i^'^ ^?^J.?^rte55e2? f is diffic.lt to 

rttf?te^wir?::^."n7sr.s?5Stnr?:irarcr.a:?r^^ 

tha leidership'a! ? s'fevel is necessary if the other interventions 
g^r •oJ'fJor riSripals!'Y ''^ "frij^i^islharthf^^eclf ' 

i:-Ssis;!iJiei?:r%;rre;;rh°a!ic^iJe;\i!,':«?^^ 

r^rr/there are^,.s.bstantial n..ber 0 1.^^^ 

Ert'rt';riirclea"ua?\hesf?elpS"rbilitt.es^ecessarily .ust be exercised 
by someone designated as a science supervisor. 

h urinhtlm r-r'" "'"'I'^p-'-nt "and implementation more ''f"'}/, "^j!! 
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fh=f ^rif^nce suoervisor role, like other leadership roles, can 
II lluTe6 ' 0^^^ "^^^ or'it can be defined to give 

attentSnmoJe to routine duties having little leadership impact 
aiieniion more ' " . ^ ]eist, this intervention costs little. In 
oractT?r hoS V l^ haJe costs at .any le,ers;f™ the school board on 

ad na c u h a Thrcost of providing support staff to whom ;.ore 
. Routine dities can be delegated to free the supervisor for leadership 

^^^^^FffprHuPness- Like the previous facilitating intervention, the 
'effec t e ' -his on'e is d?fficult to judge because of tfe systemic na ure 

of thp situation The intervention probably has large potentia , but it would 
bl naW^to believe this intervention could be implemented easi y j-ndepend^nt 
. of support at all levels within the school district including the board of 



education. 



c u.snhhinn .riPnre program devel opment and i'"PlP"'^"f.«^i°? "'?^^ i!" ' 

If^afveS^rsf t'effeclrvl^^ this intervention is essentially the 
same iB^fJ^glrin the analysis for b above, if the Pe-j^onnel ave the 
necessary science background and experience, needed to fill the role 
competently. 

H State or federal f.mrfi nn of local district plans for providing 
..ft i pJprshiD in sc ence education. I he intent of this interventToa is 

"university or a consortium such as described in C.g. above if aval lable, 

Jrf?'icitri;cause.it could be initiated at 
very Wor v Jy high'expenditure levels, fts an a'-b'trary igure n 
s.tirrallv funded endeavor could be supported somewhere within the "nge of 

ir^%VT,ir\u^e.u i^-jj,rre}?ej^;e:fsTorrhisi^u?;::??;n 

^Eff|Cl^|5^-,/8a n. "^^^^^^^ leadership development 

TnL SITCf ?;e/MgSly -ccessful and other examples can be ou 

fha?'toJll^?S?UaJive°anne:rh?p a^e critical for 
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^^rt^nf i:idScar 'nar'cifn^e^e d a^^ 

te?m. There, is little r"^"" " eaSs to the conclusion that s.ch 

:r.tr:rt^:?"rt1o:^pSt:a:irrWe rears hefore sigmncant. changes, 
becwe somewhat institutionalized on a district-wlde basis. 

= Trainina for schooi k'^^. h m»mh.r^ with respect to science education. 

he^^?t e,iona, locations Within^ 

2, Testing Programs . 

This category of interventions include'l means of ^promoting change through 

tj?e?:LS ?rb%re',pd^thrr™^^^ 

district. As a result, this collection or racii J V ^ appropriate as 

simply upon the content of the items. 

a r. nductinq awarenP^s conference s and training sessi on s in test 

Sior^Jri^r Vc^Hcl^ 

more appropriate, distri|Ct level ^J^""^^;"^/^:,, teach given topics. The 
their inf^"^"/^,°" ^a n 9 i w 

proposed conferences .^'^^ining s^ssionj, wu g^ide them with training 
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be conducted at the state level for district personnel, or if conducted at the 
national level, the audience could be either local school district personnel 
or state personnel responsible for state-wide testing in science. 

Cost: If conducted at the state level for personnel from districts 
having~tFeir own district-wide tests, the number of participants in a state 
like Colorado would be relatively small., possibly'representati ves from 20 
school districts. Assuming that some districts' would have two testing 
specialists attending this conference, the cost estimates are based upon 30 
participants. The cost is low. ..... u i. 

Effectiveness . The effectiveness of this intervention, in bringing about 
a shift in'curriculum content is somewhat difficult to determine. The first 
question in this analysis of effectiveness may be whether or not the 
participants actually would change the content of test items as a result of 
attending the conference. In this regard, it would seem that their response 
would be highly dependent upon other actions being taken in their particular 
district for producing curricular change. If such change were underway, they 
would in all likelihood be quite receptive. On the other hand, if curricular 
change is not underway, they are unlikely to be receptive to changing tests, 
and thus "get out in front" of the change process in their district. 

Assuming that some curricular change is underway in a given district, and 
--that-the-test-ing-^personnel— are-re^y-for-eharvge-in-t-es^t-eontent- 
considerable reason for optimism about the effectiveness of the conference in 
helping testing' personnel change the content of the tests. Persons holding 
these testing positions; generally have the testing expertise needed to 
capitalize upon the training. This analysis assumes that appropriate test 
items can be written or selected from other sources at a reasonable cost. 
Such action is the subject of the next category of interventions listed below. 

b. De veloping banks of appropriate test items and making them available 
to local ITstrict testing personnil i Developing test items is a time' \ 
consuming and expensive process. Ks, a result, even a commitment to preparing 
new tests as indicated above may not be sufficient to bring about change in 
testing programs in cases where district resources are limited. The intent of 
this intervention is to alleviate that problem by making available banks of 
appropriate test items. Although items emphasizing personal applications of 
science knowledge and the use of science in addressing societal issues 
occasionally are found, no extensive collection of such items is known to 
exist which could serve as an item bank. The intent of this intervention is 
to overcome that lack and facilitate district attempts to develop more 
appropriate testing. . , ^. , 

Cost : The total cost of developing a bank of 300 items is relatively 
low. "I5Fc"e this development work is completed, the test items could be placed 
in one or more existing item banks from which school districts could draw. 
The costs of developing the total, tests is assumed to be part of the on-going 
process in a given school district. j u ' 

Effectiveness : The effectiveness of this intervention is expected to be 
high where curriculum change toward more emphasis upon the applications of 
science is underway and district tests are constructed locally.- This 
assessment of effectiveness also assumes an awareness of the fact that these 
items are available. 

c. Holding an awareness conference for publishers of tests used in 
district-wide testing programT i The intent is to make publi^shers of tests 
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Lare oflurric.Ur Changes underway jnd e^ appropriate 

test 1te*5 emphaslz ng any "««°j'f '^^JJuf^s' for doing their own 
t is ass.umed that these puMishers J"^ "^5"^^ *„„„rage them to use 
be^^rSref ioTevI-r Jefts'St rnltst^n? ll ^Sssihie w?th emerging 

"'^"^irtfe 'Asr.li"ng%i"atVepJesentatives of 10 publishers are involved in the 
conference, the costs are Y^ry small. . intervention is to encourage 
Effectiveness; Assumng ^^^^4",^,^",^ ^. ^ ar change, and not expect 
tt^ese test publishers to stay current wun curr^ « • to. expect 

them to b6. a vehicle for P^o;°^l"9^J^"9e. there is every^^^^ ^h^^^^^^ 
that the participants wou be e o^^^ Jketplace as the 

Publishers of such ^fe^^^^l^^f PJ^Jests tLy prepare. But a second factor is 
prim^ary determiner of the type or tests tney prcMa considered 
a- seeming inertia and s owness to change. The confe^^^^^ 

effective ^^e' typ ca ime del y . ^ uq an e^^^^^^^^ ^^.^^^^ ^^^^ ^^^^^ 
possible and even one pub s er were ^^^ J^^^^.i /change. Recognizing a. 
was consistent with the cutting euye u publ i'/.her. Having a 

Sgni^l^al^^bfrio^lh^s^'distr^cy ^e^^ing i t! anS. thus eliminating a 
"barrier to educational chTng^'S "important. 

d. JnJoryin^^estahiished riti .en ayounta^ ^ S^^j^iJ^ 

inf l uential locar citizen 'groips. y^P^ten °ea. ^ '''%^4'"f^;',;°of°tMs 

via publications and an awareness 'inference. _ committee members in 

^ cost: Based ^ ^^'^^ distributing the 

^the state of Colorado, the cost or ^^;^'°P'"y' ^rg-g^ce for the chairpersons 

Srs't^^rtfin Coiorado -ouid he 

Effectiveness: By itself this intervention could be "pected to have 

i-aKZfruij^?rtir;ri?Sd%rp^^^^^^^^^ 

influential in the overall attempt to bring about change. 



3. Public Education 

■Since major changes in P.slic -„;-J,r,?3-ms -guire^public^^ a 
category of potentia fac itafing JJ^erveni o ^^.^^^^ education 

fSS^SBi^ ^rui-s^ortSesf 

rra"r^ertle i^Se'^hools! "x»plerSf°thIie interventions include the 
• following. j , ' 
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a nr*-- mpdiai advertis ing to promote the idea f students ■ 

Sse a iSbc service advertisements. In a manner similar to promotions of 
til Pres denM Council on Physical Fitness, these ^d^^^tlsements could 
A fh;,h All «:tiidents take more sc ence and encourage the public to 

p™th e r c anS^th^^^^ support needed for the schools to ejpan the.r 
?c?ence endeavors. An example of this advertising is recent radio "spots 
from the American Federation^ announcement time is available 

fnr t^lll^dver sements he ost is relatively low. Essentially it would be 
Z ^!?!aros of prep ring the advertisements. A possible source of unds 
fTr h s actW ty s donations! from scientific and technological y oriented 
JnSu Hes n add tion to thL development of such jd^ertisements'^by heir 
ISvertising departments, such /firms may wish to donate a certain amount, of 

^'"1}?rc?i5l:ess: ^?ris"di?f?cSl^o"udge-the effectiveness of this type^' . 
of c ambaiqn An e xample of in analogous campaign is the one conducted by the 
Pre 7en '"'council on Physical Fitness and Sports Their 30.second 
teleii^ion spots on NFL telecasts in 1976 re^ylted in nearly 14.000 written 

r-&ques-ts--£oiiJJi£0-nMtlon on school programs^ _ . 

h Science television nrno rams for the public . The intent is to provide 
for th^ g eneral p b he both VhTldren and aduUs. mo re science Programs w ich 
develop a broader understanding of science and thus generate a bro^der^base of 
su p r? for science education in the schools. Sue programs wou d be offered 
on nPtwork television, cable channels, and public stations. Wh>ie sucn 
programing hlfexpanded in recent years, this intervention is an attempt to 

expand it e^^n/^l^lJJf * 3„ large. Production costs for a standard, prime- 
time ^iho s e p ram si h'as NOVA or Nature are about $400 000 per 
hrr*^ and ai? time is additional. On a per person basis, however, the costs 

^ glfecUvlne^s : Assessing the effectiveness, of this science progra^^^^^^^^ 
for t he Durpose st ated here is essentially impossible. In addition, there are 
^0 manv Sthe? criteria used in determining what programs wi be aired that 

Usel?! a desire to promote science education will not likely cause science 
programming to be broadcast. 

c Adul t e ducation courses for the pub lic on science and technology.^^ 
The iSten to broaden public understanding of. science and "cnnoiogy .nd 
thus qenera e greater support for science education in the schools. Thus, the 
purpose of this intervention is essentially the same as b above. 

Cos?- Most adult education courses of this nature are offered on a "pay 
their^' way basis" by the continuing education units in co leges and 
iniiersities and to some extent by private educational organizations. To 
whIteJer extent one wishes to promote such offerings beyond the lever 
currently suftained by people's wil 1 ingness to pay to attend, one would have 
?o r S e h s of attending. We have little more than guesses as to how 
mSch re uction in cost would be necessary before en^o -"f ts wou d be 

' ^^rsA ,...Krf anfi Aiiv The maximum cost would be the total cost or tne 
irrsen'thus'lalling'lJSem frl U that case, a reasonable estimate of cost 

is the. standard tuition. 
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Fffprtlupness' Ever) If the number of offerings of this type were 
Incre MIf s bfta^f ial rand large numbers of people participated In t ese^ 
cS5?sel!i would be extremely difficult to assess the extent o wh ch the 
iSclrefsed public knowledge had any effect upon the public's Interest In more 
and better science education in the schools. 

Su nnarizinq the Cost Effe ctiveness 
Information for Single Interventions 

■ In the previous pages, each of the specific ^^^^rventions has bee^^^^^ 
descr bed in terms of its cost and -effectiveness as a single ntervent on. 
For each a specific cost has been given, along with a discussion of its 
potential effectiveness as a single intervention This effec iveness has been 
Presented in somewhat less quantitative language than costs since the . 
DO?ential of an intervention often depends on the particular circumstances^ 
under which it is initiated or the manner in which it is used. 

When ombining cost and effectiveness information to determ ne an 
intervention's cost-effecti veness , attention also must be given to the |Xtent 
tS which t can be used. For example, a particular intervention may cost 
JltS^toJmp!emaD.t_an_d_JX^ 
there simply may be a very short range in which it can operaTe. /^ec^l^ 
example is redudng the nJmber of "non-instructional activities" scheduled in 
the school week. If only 4 percent of the current week is so scheduled, there 
iriittle opportun ty to increase the time scheduled for instruction, even 
ihoi h the little gain available could be acquired at small cost. The worth;, 
nf A nivpn intervention depends on a variety of factors. 

°^ ' ad effectiveness information is combined for each sing e interven- 
tion and presented below in four matrices (Figures 2, 3, 4, and 5)-one for , 
elch of the four major objectives: quantity, quality, appropriateness, and 
facilitation In each matrix, each specific intervention is given a location 
des anated E; the letter or number and letter combination used for it earlier 
in this repo?t This location in the matrix gives its relative cost and 
effeaiv^nesrcompared to the other interventions in the matrix. No scale is 
aiven on eitheFlfrr^f the matrix simply because it may imply more precision 
in the determination of cost or effectiveness than is appropriate for a given 
lEtion The location of each intervention on the horizontal anis is based pn 
the cost information presented in,Table,3^as compared to the other . 
interventions for that objective (the cost scale for each of Jhe four matrices 
s nolthe same and the scales are not necessari ly 1 inear ) . Simi 1 arly, the. 
ierHFal axis portrays relative effectiveness. In both cases, the axes are 
divided into thirds designated as low,- medium, and high. _ . 

Because of the large variations in cost and ^effectiveness ofcthe 
interventions and the fact that choices must be made among the possible 

! ns only those falling in certain sectors of the mat^Kes pro ably 
should be considered. First of all, any intervention f ^-'1 "9 " , 
cost/hiah-effectiveness sector should be given immediate attention. , 
U^fortirate y! they are few in number. Second priority goes to those 
' iJterveStions falling in the medium-cost/high-effectiveness or low-cost/med um 
efflaWeness sectors. As a third priority, consideration may be given^to the 
Sic s"/mediSm°effectiveness sector, a single in erven i^ 
fallina in one of the other three sectors should be given low Priority, une 
caiiion must be given in this regard, however; an intervention that does not 
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Figure 2 Cost-Effectiveness Matrix for Single Interventions 
for Objective #1:. Quantity. 



(See page 
matrix.) 



16 for a description of each of the interventions designated in the 
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Figure 3. Cost-Effectiveness Matrix for Single Interventions 
for Objective #2,: Quality. 

(See pages 16-18 for a descriptiefJ %f each of the interventions designated in 
the matrix. ) > 
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Fiqure 4. Cost-Effectiveness Matrix for Single Interventions 
" for Objective #3: Appropriateness.^ 

(See page 18 for a. description of each of the interventions designated in the 
matrix.) • ' 
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. Figure 5. Cost-Effectiveness Matrix for Single Interventions 

for Facilitation. 

t 

(See pages 18-19 for a description of each. of the interventions designated in 
the matrix.) 



look vefv attractive as a- single intervention may be a critical cortiponent of 

viewed g y bu i ombfnat^ons. some comments' are in order regarding to the 
single fJJerJenUons displayed in the f our imaVri^es for the four ^objectives as 



single 
fol lows. 



Quantity. In the matrix for single interventions for Objective #1: 

over a five-year period. .Even if additional supervisory support were utilized 
in add it on to the inservce' education, the cost would remain very low 
ompVeS to tSat of other interventions under consideration for increas.g the 
aStity of learning time.. A second priority intervention is increasing 
quantity « , ^ effectiveness and higher, in cost than the 

Sr nterv t it tin d serves consideration.' Finally, consideration 
caSbe i en to he medium-cost/medium-effectiveness category in which are 
found the i nterventions which would cause students to enrol l in we science 
courses While substantially higher in cost, particularly for the students. 
tSe nc^eas i si nee learning is substantial, and also quite certain given 
an appropriate curriculum.. They are worthy of consideration. . 

nii^litv No interventions are found in the low-cost/high-effectiveness 
Quality. ^° 3) y^e low-cost/medium-effectiveness category. 

luh ith^r oca! develoS»ient work or (..proved teacher evaluation Procedures. 

i°akni?:rt?e?Nri"t?i^:^^rrof 
rFif ;Tontrin?irs"rai?^^ 

seaor wh ch includes several interventions related to teacher education. 
UhilSthev are clearly long-term rather than short-term prospects fpr, 
im iovfnTscience eduJatioS, the role of the teacher is so central to quality 
education that these interventions should not be ignored. 

ADDrooriateness. While the scale used for costs in. this matrix (Figure 
ca'eaorv for improving the school curriculum are so ow on a per P^P^l bas s 

S Fe/Si?^:2e;r?r::nti2r.:i 

X^'ZllJ pertain to Colorado ^^-^ L^rtlte^^^re the 

textbook adoption process. It Perta ns on ly tu a vc jr 

population is large ^-"^h^to e a s.gn.f an J rte r and^where the 

?j:ngrs^n?ta,^!5t'?h:i:;rerv'2nJi:Ss J^J'uSed in the .ediu.-effectiveness 
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category all involve mechanisms for developing n€w curricula; there is a 
variety of approaches. A crucial question that must be raised in connection 
with development of new curricula, however, is whether or not there is a 
process by which these new curricula will be implemented in the schools. 
Though not specifically addressed here in the context of curriculum 
development, this issue will arise again when consideration is given to a 
combination of interventions. 

Faci 1 i tation . This fourth objective deals with interventions which make 
it possible to bring about change in the schooTs; they should be viewed as 
interventions which make possible the actions described in the three matrices 
above. In that context, many of these actions may be critically important and 
essential, if the other actions are to succeed. -For purposes of this matrix 
(Figure 5), however, these interventions are considered on the basis, of their 
effectiveness as interventions in and of themselves. In this, context, it is, 
not surprising that none of them appear in the priority sectors. 



Chapter 4. Combinations of Interventions: 
An Imperative for a Systemic Problem 



Several references have been. made in the previous chapters to the 
systemic nature of the school situation in which improvement is being sought. 
This perspective highlights the inadequacies of examining the situation in. 
terms of single, independent interventions. An adequate analysis must account 
for the power of combinations of interventions (the. effects may not be simply, 
additive) and interactions which may occur among the interventions. 

If it is granted that the situation must be analyzed from the perspective 
of a combination of interventions, one is still left with the question of what 
conceotual framework should be used to organize this analysis. Fortunately, . 
the last two decades of educational research have yielded numerous findings 
which when taken together, can provide the needed conceptual framework. , 
While'such studies are numerous and diverse in topic, there are three streams 
of research which have been particularly productive and have special potential 
for orovidinq the guidance needed in this ..analysis. These three include 
research on (1) school effectiveness, (2) implementing educational change, and,. 
(3) the role of school principals. Each of the three will be examined to 
dentify major findings and implications of particular note for this, analysis. 
In view of the extensive nature of this body of literature and the 
existence of several extensive and carefully done reviews of the research in 
these areas, existing reviews have been used as the basis for developing the 
conceptual framework described in this chapter. Four in number, they include 
the following. 

Gene E. Hall and Susan F. Loucks. "A Developmental Model for Determining 
Whether the Treatment is Actually Implemented," American Educational 
- Research Journal , Summer 1977, Vol. 14, No. 3, pp. 263-276. 

Michael Fullan and Alan Pomfret, ."Research on Curriculum and Instruction 
■ Implementation," Review of Educational Research , Winter 1977, Vol. 4-7, 
No. 1, pp. 335-3977"' '■ . ^ 

K. A. Leithwood and D. J. Montgomery, "The^Role of the Elementary School 
Principal in'Program Improvement," Review of Educational Research, Fall 
1982, Vol. 52, No. 3, pp. 309-339. , 

Michael Cohen, "Instructional Management and Social, Conditions in . . 
Effective Schools," i.n the Fourth Annual Yearbook of the American 
Educational Finance Association, School Finance and School Improve ment: 
■Link ages in the 1980s , Allan Odden and L. Dean WeDD (Eds.), CamDridge, 
MA: 6al linger Pubhshing-Co. , 1983.1 
' ■ • • " I ' ■ 

Although these reviev^s are focused mostly upon the direct findings,, of the 
research on these topics, there are some instances in which the reviews extend 
bevond simple reporting of research findings to making extrapolations from the 
data to various school situations. This is a positive feature of these 
reviews- even though these extrapolations are to some extent speculations 
about the implications, of the research .findings,, they provide valuaole 
insights as to the implications of the research for educational practice. 
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l^^l.. E^:„^5Sre'«su";tThrere::ntarySeve, and U focused .ostly 
u°pon reading and -mathematics skills. 

While the secondary school studies are general ly consistent with the 
?ngs from the elementary level, our knowledge base is much s ronger 
• I! the elementary grades.. Because secondary schools generally differ 
. ?om elementary schools with regard to-size variability ^".^ jdent 
backgrounds, organizational complexity, goal diversity, subject Uter 
n?fe?inqs and developmental level of the students,, the application of 
findings from elementary schools to secondary schools needs to bemade 

with caution. 

While these limitations must be recognized, the school effectiveness research 
literature is quite extensive and provides a substantial basis for making 
iecisjons as to the appropriateness of various interventions for improving 

education . ^^i^.^ this chapter, attention will be given fi'rst 

to re a he character of effective schools, and secondly o research on 

tho n^turp nf successful processes for implementing educational change. 
Mna fv atten oh w be ?urned to the research on the role of principals 
s nee this factor is shown in the. former two categories of research to be 
unusually important for both effective schools and for implementing. „ 
educational changes , . • 

Research on. Effective Schools 

Rpfore examining the characteristics of effective schools as identified 
K llrrl U s will to note two general items that appeared in this ■ 
^s ar te at e^^Vir t!°accordin^ to Cohen, "comparing the schools on the 
re ounces that are avail abi; to them is not as meaningful as comparing the 49 
^r'ools on how well they organize and use their available resources. . . . 
In o?her words just pro vidtng add itioiTaT resources to the schools is not the 
In 0^^^'^^'^°^;;' p^^gctiveness. Particular attention must be given to how 
S're o r e w led f^' what purpose, and by what means. Secon y. 

f %h1t cnmp nractices or variables pertain to the classroom level , while ... 
ot er p r ai nth hopl level . A multi-level perspective musxe 
others pertain to. tne , . -■ ^^is multi-level perspective will be 

■ exle d I0 the h 1 tHc? s^ate. and national levels as well, 
extended to ^c identifies three themes in the research 

• literatuJe on effective schools. The characteristics of effective schools can 
literature °" ''J^-,. cateqories: (1) effective classroom teaching 

'nrJt?^es ( 00 na an m:^^^^^^ of \he instructional- program at the 
Eund nq ie e and 3? shared valuet and culture among both students .and 
sta}? These three themes will be elaborated upon below in considerable • 
detail based upon the review by Cohen. 
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Effect'ive CI assroom.Teachinq Practices 

The effective classroom teaching practices .shown by this research pertain 
nl tP^rhP^r*' exoectations of students and the role teachers occupy, 
)^ e a omTna emrt%rac followed, (3) an active and direct form 

if inctriirtinn and (4) careful attention to -a maximum amount of academic 
fea^n^^g ti^for stiSents. With^espect to teachers' expectations and their 
role. definition. 

Effective teachers' believe they have the capacity to affect the learning 
of students. They take responsibility for teaching, and "e""ary 
re-teaching, to achieve student mastery of the material. They are task 
■ oriented, business-like, .clear in their instructions to students, and in 
aeneral take charge by monitoring behaviors, choosing instructional _ 
activity and developing a classroom with a distinct focus upon academic 
matters. There is a sense of .purpose and students are held 
accountable.^-^ 

These hiqh expectations are encouraged and their attainment fostered by ' 
'effective classroom management. These practices "keep students engaged in 
'a ademic tasks, and minimize classroom time 1°^%?^^^^° ^3e.,ell ' 

transitions, and other procedural tasks. . . . Effective teachers use wen 
organized and prepared lessons, which enabjj them to move through 

instructional activities at a brisk pace." _ n».;,rHrPQ arf*' used in 

These high expectations and classroom management practices jisea in 
support of yet a' third characteristic, namely an active, direct form of 
ins??uction by these teachers. «This form of instruction is "of highly. . 
iSdiv^dua^ized and does not have a substantial discovery learning flavor. 
There are specific goals-' and they are diligently pursued. „ _ 

The fourth practice is careful attention, to the fulles use academ c 
learn ng time. The time allocated for instruction is important. "I^achers_ 
iho anoca e ^ore time to a partic ular content area have ^ jdents^w h higher 
achievement in that area, compared with teachers who allocatejess time. 
Anbiher characteristic of these effective teachers is that a. high percentage 
5 the a cat tL is actually engaged ^5 learning "The higher he 
pnoaaed t me the higher the achievement."^^ It is also important to note 
?h^? therrare major variations in engaged time among teachers. Studies have 
fhown^freL engagemen^,%ates to vary Vrom as low as 50 percent to highs which 
. approach 90 percent." 



School Level Instructional 
Management and coorqinaiion 

In addition to the characteristics of individual classrooms, effective 
schools are characterized by two building-leve , "'^"ers. . First Cohen 
indicates that the curriculum and instructional program, is ' tiqhtl v couplep. 
in other word , goals, objectives, instructional content and activities and 
[he meaLres of performance are "carefully aligned." The who e school takes 
nn a character consistent with the individual classroom practices xi ted 
oar?ie? There aJe uniform time allocations within the school , shared goals 
wc^rry more weight than individual teacher goals, common expectations 
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among teachers and other prg|ess1ona1 staff, and testing is both important and 

''^^TecaSsrofTtrimpo^rUnce. the concept of .principal leadership is 
H»«.inn«ri in some detail in a ater section of '^this chapter. In general, 
howe ef i can be sa that the effective principals (1) have a strong goar 
Station i.e.! they emphasize achievement, set goals, develop performance 

Shared. Values and Culture » . ' 

and never ending. 

c 

Research on Implementing Educational Change 
The change under consideration here is curriculum change including^^^ 

a plrtic2ur innovation and the degree of value ,nternaVuat,on that takes 
"""TSfproSes! or5n^?o"d2cing an innovation or curricular change is cojnplex; 

'S^TtLdi:;^^^^''^^ ^ iSe-intfatl^nThrt'- 

1e en t tS^e."' On a five-poin? scale of quality, n e average saff 
;rn?e5 for the twelve criteria range from a high of 2. '.to a low of ^1.3 with 
t'pS criteria below 2.0." There are decided variations in the extent to which 

0 aUons'are ilpLented in schools -d t|| extent to, w ic par icu a 
rnmnnnpnts of an innovation are implemented. There are dirrerenx 'eve o' 
use of an innovation; the actual presence of g5 innovation can be established 
as a fa?t iSly by assessing Jts use directly.^" It^Hnn 
tLt I?Sdent achievement is related to the extent to which anjmplementation . 
^rfualTv bJcu?s^^ Research establishes rather clearly that the degree of 
fctual imp"emeniation of an educational innovation is generally much less than 
described in the intended plans. 
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. '•An obvious question is why attempts to implement educational change ^o 
often f ai 1 . 

ThP main oro'blem appears to be that curriculum change usually _ 
IScesstates certain organizational changes, particularly changes in the 

role retation^ips of those °^g^-"J-"^VHr^\ra? is role 
directly involved in putting the innovation into P^act ce. That is. role 
occuoants are required to alter their usual ways of thinking about 
tSemselves and one another and their characteristic ways of behaving - 
towards one another within the organization. 

Researchclearly establishes that the most difficult aspect of i^fo^ation is 
■ ngTn about changes in the roles of people. In gf ^ ° f ^' 

nroaram and structural changes are relatively easy. One aspect o^^^i^ 
difficulty may be the inability of principals and teachers to understand the 
nroces n which they are involved. Research shows principals do not have a 
5oo5 knowledge of the degree to which an implementation is occurring in their 
school Similarly, the majority of teachers apparg^tly have difficulty 

identifvinq the essential features of innovations. . , , -^u- o 

The comolexity of the implementation process, particularly with respect 

^0 chanainate roles of people, makes it difficult to prescribe ahead of time 
he efac form an innoJation'ev^ntually will take,. A mutually adaptive . 

process involving the innovation.g^he .user of the innovation, ana tne 

institutional setting mus.t occur , „,,Hr..larlv oertinen 



'""'"'T^S^ o^he'innovation process particularly pertinent to this 
analvsii is the need for several factors in combination in order to bring 
abo rin mportant change. Research shows that it is the combination an , 
interaction of a variety of factors that constitute the essential ingreai 
for imp Ure nuttorof an educational change.^^ "It is important to note 
;S^sr?i tors .re interactive in the sense that they .ay^be mutua ly 



s 

that 



these factors are inLera.ctive m. >.mc ^^..o. -:y"r^^.' „thprs would 

reinforcing over time. The presence of any one without the. .others '^gV'." 

ItoTuin c" beTur.ed to specific policies and practices necessary for 
producing change. . 

Policies and Practices for Implementing 
Educational Change- 

The following description of the policies and practices which research" • 
.hnws to.be effective in implementing educational ■ change are largely organized 
wUh n ^^^r es developed by Cohen. The first five of the fol owing major 
^IteJSrie are h s. although information obtained from other reviews is_, 

faSf "praji 7^^^^^^ ^Z^.^^^ .^ 

€Sio':sxsjnrr3r:rL^^Lrfrien 

in adduSon, aUention will be given in a sixth category to central school 
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district policies and various socio-political factors that influence the/ 
process. . • 

School Improvement Programs 

A ^mnnr^ant local level step Is initiating school improvement programs. 

are deveToped locally, ana . , ^. i,ack it uo it appears that 

^vtonciup rp<;parch literature is not available to oacK it up, it 

T^^m^r^'^ Thf .'anner ?n which such school improvement 
programs, are conduqted may be critical. 

Strategies for Increasing 
Tn structional i'lme 

w;,riPtv ofUtrategies can Increase both allocated and engaged ' 
allocated time, (4) ^'^^^^^"fj"^ " „ ".u- ^.^g of time. Potential strategies 

findings. It Pfooabiy is wen appears that intensive inservice 

educ Jirc n t slmply be considered 
In I global inse without attention to its distinct forms. 



Principal .Sp/lpction. Training - 
and Development 

■ ^ <;inrplesearch shows principal to be a most prominent variable in the . 
• -^1 mlnJ^/inn n^ocess careful attention must be given to how they are 
implementation P^o""» "V^'". their professional development. Based on 
selected, /^rained and as sted^^ P o ^^^.^^^ 

these '•es^'arch findings ^ve prominent attention to (1) improved 

..im'plement ng educa^ the instructional " 

selection! procedures whi^ -^Jospective candidates for the position, 

ETresi V f cSse'd'more on bui Idi ng-level instructiona ^ . 

fa Lrem^^t n is found in current programs, and (3) 
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'improved inservice education for princ)gals focused on building-level 
instructional management competencies. 

Ti^^htening the Focus of the Curriculum 

■Because of the importance that the research on effective schools gives to 
a tiahtlv focused curriculum, policies and practices for implementing positive 
educational change must include attention to such curriculum characteristics. 
Cohen argues that these mechanisms could well include the following: 
(1) district-wide testing programs that focus the curriculum on important 
goals; (2) school-wide planning endeavors focused "on a limited set of 
instructional goals"; (3) district-wide curriculum development; 4) district- 
wide policies on high school graduation, promotion, instructional time, and. 

. expectations of high student achievement; . and (5) plans and goas y^ich have 
been agreed upon jointly at both the building and district levels. Other 
research provides further information as to the nature_of such endeavors. in 
our review of research, there are two characteristics of innovation that stand 
out as being related to implementation. These are the expl icitness or plans 
for explicitness associated with the innovation and tk^ complexity or degree 
and difficulty of change required by the innovation." The research also 
highlights the importanc e of feedback mechanisms within such endeavors. This 
term refers to "the nature of the interactive network during implementation. . 
. . It is somewhat global .... refers both to feedback structures and to 
norms supporting open feedback, as well as to interaction involving several 
constituencies such as teachers, consultants, administrators, and^ideally 
students, parents and others. . . . Most research we examined cites the 
absence of.the feedback networks during implementation as a critical 

. problem ."^^ With respect to testing programs it should be "J^^d that studies 
of actual practice in schools show a relatively low overlap of the content of . 
tests and textbooksV it ranges between 14 and 50 percent. There clearly s 
substantial room for improvement in this aspect. of the process of tightening 
the focus of the curriculum. , 

Structural Features to Shape 
School Values and Culture 

Research shows tha-t the values and. the culture shared within a school are 
important determiners of school effectiveness. There .should be mechanisms, for 
increasing the extent to which such .values and culture are shared w,i thin a 
school (1) Efforts should be made to increase building-level autonomy even 
if it requires a reduction in the degree of uniformity fpund within a school 
district. (2) Provision should be made fcir as' much parental choice as 
5 sib^e concerning their children's education. (3) Time mus e Provided or 
teachers toengage in "shared work and collective decision making. That is, 
nrpater olanninq time must be provided by any of a variety of mechaaisms. 
llTof ?lese tLe changes has the potential ?f d^-J.°Pj"9 a s ronger « 
set of values within a .school. Research has shown ^^^commonal ity of Purpose 
-and. values to be important for effective schooling, ./he third of the thr^^ 
factors mentioned above with respec^t to values and culture is of Pa^J^cular 
importance. Research shows this shared work^^nd decision making is, related 
significantly to measures of implementation. 
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Centra.1 School District Policies ^ 

Bv and large, the 'above five categories are mostly building-level 
Dnlicies Sr oract ces, though several are a combination of building and 
d?liHct ?evel Add tronal mechanisms, can be pursued spec f cally at rthe 
A- Z]rl oup Rp5earch shows typical district-level policies do not 
c rnnnlv ffl Lce mp^eme aUo^fpFTiarily because they do not address the - 
^osr'cHtical "factors' Among possible changes in typical current practice are 
the following. 

" First instead of promoting specific innovations, central policy makers 
shou d Je emphasizing broad^based programs and P'-fiding corresponding 
support for local development of specific forms of ;^"^Ple^e"^/^,;°"' , 
thprebv facilitating clarity and explicitness of programs on the part of 
thereby ^^^i i itat^^g^ local experimentation should be encouraged during 

imolementation ,to develop varjance of innovations. ... [hird, 
eva uation of innovative projects^ at least during initial imp ementation 
should be directed toward facilitating imp lementation in local system 
caoabilitles .. Fourth, and closely related Lo tne previous pomts, 
\ the incenti - vi y tem for implementation would have to be drastically 
alteJed at all levels. There is one finding that .stands oat in our 
= tllTZ it is that effective implementation of social innovations 
i rlqiJestiml personal interaction and contacts, inservice training and 
StSer forms of people-based support. Research has. shown^^ . ... there is 
no substitute for the primacy of personal contact. ... 

District policy makers also should give particular attention to a 
'distinction foSnd iJ the RAND studies of ^^ucationa Innovation T^^y^^ 
"identified two contrasting types of adoption process that characterizea 
n mer s projects they investigated.' They terpied ^ ^se gPpor tunism n 
problem solving ." Opportunism describes P'"°Jec*f,^"j;^f ,^^"nse to the ' 

Eh^se iJic^had locany'identified need. The pr^^lem-solving projects led to 
"greater changes as- a result of the innovation. 

Research on the Role bf Principals 

rnnsiderable research has been done on the role of principals as it . 
.i.tpc^nthPir effectiveness in increasing student learning within a school 

imp^rtanie of the principal requires that it be. examined in greater detail 

'^^''^'to understand the principal's role, one must recognize that it is 
' inherlntW complex and ambiguous. Central school district administrators 
ofte^ see prin? L rather than educational leaders. 

?hese centfa administrators tend tS be conservative about change and want o 
nitiate it themselves rather than having it begin at the school level. S nee 
research Thcis Tat such change is most effectively initiated at the building 
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. • • c ch,f 1-hP nrincioal's role has some inherent conflicts, 
level, it IS obvious that the P^^^^^J^' ; arising at levels below him or her. 
in addition, the principal faces pob ems a^ _ ^ ^^^^ 

Research shows that among teob^aced by^^ ^ ^^^^ 

knowledge and professional ^ki' s on -ne pa constraints introduced 

teacher motivation to make ^^9";/^ in ddit-on, there is a 

by collective bargaining and union ^^"f ^^Jf'. ^^'^ Attempts to introduce 
pervasive norm of teacher au onomy in he .ho^^ pt ^^^^^^^^ 

shared planning and ^ork^. l"^P°'^^';^,,''o?m A further difficulty is that 
literature) are i" .opPOV^ °.n^U ov^r those aspects of classroom life . 
principals have ".inimal d.^^^^^^ increase the ^ 

^f^c^^iZ X^ ;:r;croi, or seek ng to introduce significant 
educational c^yjige, ^^"V"^"''''?"^ , "to the "effective" one) provides 

principals differ substantia ly u, the en^^ "administri vi a." 
Typical principa s ^epo f 9 d e t e routine matters efficiently and 
fp:^5^J^^srdrr^ab?e^^timrilVat?.ers of true educational 

^^^.^TfJ^cttve P^^--Pa1>ehavi0r can be examined in more detail w three 

major categories pertaining to (1) f ^^^'.^^i/ 
achievement, =and (3) strategies employed to do their job. 



Goals 



. Specifi: goals P^ay a .prominent role in^the wor. o^^^,^^^^ectJve principals. 
•In addition. to Ijeing Prominent happiness of students fivst in 

"Effective pr^ncipg^s P ^^^H ghe^^ priority. A key point is "the 

•their priorities." students have effective from typical 

central role of , ^ ^ p s I the rocess of planning and goal 

principals. . . • ^^^^^^^^.P'^ hv tpachers in decision making- and. 

formulation to encourage parncipation ^^^^^^f^^^^^^^.es^se^^ to clarify , 
^irtivelv solicit their opini.-ons, ... ihe goais ' ^'^..S^ . u^^^ to 

■BtiiJV^Xr^^^p^^-^- ---- ■^ 

prominent throughout the research literature. 

Factors Affecting Stud ent Achievement . ' 

' ,, Effective principals give high pHorU, ^^^^^^^'^T'- 
,. sturtnt achievement.J They use objec as . fo . 
basis for seeking improvement 'J^'^J "9;„,;j„^,o„a.i Objectives. Attempts 
allocation decisions based u on J j and instructional 

are made.ito bring about, greater coord^at. on or g focused .^ 

:^r^^;^rS^Uo^al"goa^s!'T:e gSa^^^n^ objectives ar^ prominent in each of 



. • cf f hprp I th respect to the work of. effective 
pMncrpals!"the^Sor : "%he''pre;iSus discussion on goal, beco.es even 

^^\o. to t .cus upon ?oals effective principals are con^^^^ 
about selecting and develop ng "mpeten aff ^hey are wi 1 1 g ^ ^^^^ 

time necessary to perform of fun available to them, 

have a particular ^lew toward the various sources^^ their own 

Whether these sources be government agencies special " ^.^^ 
school board, or externally funded projects, etrggnve pr ^; 
possible sources of funding for their own goals. 

Strategies ^ 

. ..tffectwe principals were ^^^P^on^l'^.f JSe^'lf'^f y,;ctWe' 
identify effective ways of achieving their ends." These effective 
^augists have ™any things in xo-on as des^^ 

The strategies are at ' ftronq belief in the goals 

fJ^^^^^'^o;'th^ir"s^So is' n a;e i c"d ?hrsrh?orsyste. can tolerate 

they hold for their scnoois ^^'^ r ^.^^ whatever stefTS are needed 

enough diversity that they can ^^^^^JjJ 'f/be ?eve! These effective 

to accomplish the goals in which ^^Jey so f o"g r . ^^i^^ their 

principals also cfud ng the superintendent and whoeve 

ideas to...the community and ^he staff . ncludi ng tne^^^^ principals also are 

has control over needed "^"9^ ^^^^^"'^f:. derate ^ut^ it was dor 

• willing to share decision-making power and delegate a^^^^^ ^^^^^^ 

within a framework which they f ) : uL^'^o'ld/resrcu^^^ problems 
teacher participation; ^ " f the norm!^^ Effective principal 

. -.?,--^-thet :u?rtS Tef ^th:tri:rgo is! Vuding goals for their 

work with teachers on issues ijf tified dun 9 cl 5^00^^^^ 

• arrange for and encourage eachers to pa ticipate in ^.^^ . 
developmefit activities mit ated irioat on in teacher inservice 
effective principa s have it -le ° . °.P^^ ^staff members in gainingg 
education activities Effective principal^ professional development. 

= ^™'"E?nc?i e ;"n 'r ron'cerJ^d'Sbo:? the needs of teachers in 

"Effective princ'ipals are very ^^'J,'^'".^^'';"l levels is importanl 

■ ?f ^r?oJJterSpoi rt?a^rg"rp^c:f.i?Ta";r-°^-* 

^^Z'l^^^'^^ 1^)'??:sfp^i:"Sals Sor. toward this 
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nn.^ "hv attPmotinQ to influence a complex set of' classroom-based and school- 
Si e fa^to 7 3) ooperative interpersonal relationships a^^ viewed as "an 
^nstrumen? to goal achievement, not an end in Us own right." 



Implications of This Research 

While the details of this analysis of the research on effective schools, > 
mechan? ms for implementing curricular change, and effective principals alo 
!nifal used in selecting combinations of interventions in the next section of 
^ rep rt, ihere are three major implications to be identified here as 
qeneralizat ons-upon which th. further analysis will be based 
^ F rst the importance of a combination of interventions is clear. 
Soecific interventions cannot be examined in isolation. Particular 
combinations must^be utilized based upon what research says about appropriate 

combinations and ^^^^^j^ j^^.-f particul ar combination of . interventions may 
be critical! The re'search indicates that the lack of a particular 
intervention from a given combination may be sufficient to eliminate 
attainment of the goals to which the combination is addressed, 
attainment ot tne 9 .^^ interventions is selected it must be 

based S'a multi-level perspective, ^ome interventions must e in ro ed 

rtt na/leSerrt^^Sff^ll^ndVoper att^^ lower levels 

at which research indicates the interventions can be effective. 

In addition to these generalizations, there are specific actions which 
are prominent within the three streams of research. 

Integrating the Three .Streams of Research 

• Takpn toaether these three streams of educational research reinforce the 
importance S'sevfr^l kinds of , action at the building and school district 
level, they are summarized in the following lists: 

Principal 's Actions ' ^ 

0 Develop school-wide goal setting .^and explicit planning for ^change. 
,0 Give high priority to supervision and evaluation of instruction. 
0 Develop procedures for shared work. 

0 Provide support services for teachers in implementing new curricula. 
0 Use great care in select ij>g new teachers. 
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0 Develop feedback mechanisms for receiving information from within the 
school . 

0 Initiate a school improvement program. 
Oistrict Policy 

0 Establish policies on graduation, promotion, instructional time, and 
student expectations. 

" 0 Establish an appropriate policy on school autonomy. 
District-Level Actions 

0 Carefully select new principals on the appropriate criteria. 

0 Provide inservice education for principals focused upon (a) leadership 
for effective schools and (b) developing goals and participation. 

p Support the development of i nnovation- at the building level. 

0 Make the testing' program congruent with instructional goals and the 
curriculum* 

0 Initiate and support curriculum development at both the district and 
building level. . 

0 Provide inservice education for teachers at the district and building 
leJe fo used upon (a) teachers' expectations and roles (b) cla sroorr 
lanagementr(c) active and direct instruction, and ^.d) learning time. 

Combinations of Interventions 

With the review of research on effective schools and i JP'' eventing ' 
priMrational change as a foundation, attention again cf.n be turned to the 

' Be a °e o? "his sjstemi? viewpoint, the '?"it. 
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given to (U the degree ^' :-"f,"°"/'"Bj?,<ii„g, or teacher) at which the 
!eveU ("»t'°";'',fS''i„ "tialed and (3) the time frame (long term or short , 
i^J^rtr^hicrrhr in?e;:;Juof ia:2e^ip.cted to he effective. 

Qb iective »1: Quantity 

l^^^easihOtudent ^e.uiremenn The value of j-vation jhj^s^area -s 

2:re:5eJr?oJih^r.^?;T;royei?jj IfjS 

interventions ^Je^^ys em c " . p v ously ment^one.^^ 

^^^eraufar- .^ ^^^^^ ^'^^^^ 

ra^r;5"'?"naUy!^ t r^r/ e noted th t .^^^^^^^ ■ 

y ar ll initiated only f .' Je " \i^„ f e teracttve, the 

Because th s category of interventions noi veij , , applies when 
analysts presented earlier for single ' f ^. ^ leasing the amount 

SucLsin combinations. I"^;;"^"?^"' f The most ?ose- 

of class time actual ly used for i.r ruction f f f'l „ ^ greater 
effective. The cost of acquir ng fpJ/S ' is needed to implement the 

amount of inservice The cost of increasing homework 

l^rirJ:ratw:iy"o:"afirasr.;n,?e?lf if expenditures of tax monies. It 

iirea^^nr^cif e co-se reouirements ^^5^ a55^?lfnar:rahlrapproach, 
requirements or " ^f„^' ^ ° p ^ah ; -ly should be considered as 
^aSSii-o^tritrps-trhfureraJ^^-Screasiglea^^^ 

-^-f,r,irho:e?i?!^nrour^a::ne^rtre:^5on^?rth^tntervenu^ 

to the appropriateness objective. . ^ learning time for science even 

If one wishes to increase the Additional increases may 

further, the cost P^°^^ l^^^;i^;,^,? f,^e r n ^\he school day or the school 
require such measures ^^^^IJ'^^f ^^"9 j^^^^^ is little doubf that these 
rersir^s w^i^ in^relfe refrnrng^rt'ou^lociety must be willing t.o pay the 



°price involved. 



Objective #2: Quality 

This o«.ect,ve.nas.everal categories - 
quite interactive ""^'."J^^" 'Lrlentions are fairly long-term n 
'nre'NhrlfvirU :Suh1hrinte::ertionl can best Pejnitiated vanes. ^ 
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The interventions for this objective will be examined category by category in. 
the following sections. 

Preservice Teache r Education . This category of interventions is not very 
^nfP.^ we fe ft-^c-aT^T^idered quite independently of the other 
JterSen ons it a long-term category, however, in that the impact wi 1 
aJe con d" ;ble time to be noticed. Changes in preparation P^og'-jms wi 
Sot b"ln tan aneous and the number of new teachers in any ^^vf school will 
nnt be arqe for some years after teacher preparation changes take place. 
Sh le t e tate c n initiate change through certification '"equirements. 
in native at the institutional level clearly will be essent al . The 

? rif analogous to that of initiating change in schools where research 
chnw^ that there must be initiative at the building level. 

Seve a of the interventions in this category are rated medium- 
rn^t/medium-effectiveness. Some interventions involve greater^science - 
nreparat on for e ementary teachers; research on the relationship between 
^rience background and teaching effectiveness indicate promise^for this 
ac ion Lengthening of secondary teacher preparation also holds Promise . 
P.ipri;ilv with regard to professio.nal education. Research shows a positive 
cofre a on between teaching effectiveness and both the amount of a teacher's, 
scienf background and professional education preparation. Since science 
rPrtfftcation in Colorado requires nearly 60 semester hours science (and 
the e ea^Jh q ves some indication of a "plateauing" of the -'e ationship 
between science bac ground and teaching effectiveness at less than 60 hours) , 

Finally the inclusion of courses emphasizing the applications sc e .e 

require changes in the science curriculum of the sciicols. 

Inservice Educatior o f Teachers . ' This' category of interventions ^s 
hi f nteractive in th ?:-T?^iim3e education programs general ha e not 
pv d^^nced Mqh impact, while inservice education also has been identyied as a 
rHtical part of educational change endeavors. In essence mservice 
pS.Sition set % as an isolated activity independent of other activit,^. 

f^K w Ji 1 nrnduce few results, while inservice education set up as part of 
r°b r e ?SemenuJ^^re?^ will be effective and in fac may oe 
. ential to the success of . the overall endeavor. Inservice education is a , 
relatvey short-term intervention although the overall endeavor for ^ 
m : nJin change of which.it is a part {^^^^f^^^^^^^^^^^ 

o/r\o6 of some years if the innovation is to become e^tablisnea. inservice 
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its impact unless 
endeavors. 



111 rln Jet the existence of a minimal base of such support n most schools. 

^rrJent^or-nVo^c^SJ^ih:: Ih^;' Jrf^d^iS s'SL'spec.fU ,oca, need. 
Jfnlncial assistance available Is not of a magnitude that can be expected to 

Xllt Intervention .a,in, significant effectivenes^^^ 
cost, is summer employment for teachers. Its cost ^\"^9niy w ^ 

^t}''^ *s^s;srSf't?froL™" du rtion^are«:rtire°nfs5r"4e"r. 

f,„i^s should make every effor? to deter»,ine if summer employment of 
teJJherfca!; bl i:ft1at:d ^n'ways which are not prohibitively expensive. 

Obiective #3— Appropriateness 

Imorovinq Schoo l Curricula . This objective, and the corresponding- 

curnculu.,, projects of ^he last quarter century sno terms of student 

curricula macenals, m and of itself, can d£ 5""^:^' imnact of these ' ' 
5earning. Other ^^vidence indicates owever tat e.mpaao^^ 
curriculum projects^ could have l^^en much greater if better mec o 

,rvou"tfi:p ement,tion of the resulting pro^ 

The experience of recent facades w.th respect to ^ curriculum 
science programs ''"E^' '9ht5 "lost prom.nently the neeo 

.fo::]rfbet^;:reren:::ta^;1?boSl-sc:iJJe^'curriculum projects still to 

89.:" 



94 Yu • 

be current appropriate, and valuable for elementary school use. 'hfir use 
in Jhl crhnnls however is not extensive. At the elementary schoo leve , 
Se evi c s ro g that a high emphasis must be placed upon faci itating 
the use of curriculum materials, not just develop ng them. .This need Point 
to strong district- and building-level attention to implementation efforts in 
tandpm with any production of new curriculum materials. 

More than the other categories' of interventions, this one probably shou d 
be pursued a a variety of levels, including both federal and local. There is 
a need for curriculum materials giving more emphasis to the applications of 
lr\lnce The federal role could include curriculum development Projects, 
operating in a manner similar to the earlier NSF projects along with the • 
dPvelopment of models and resource materials that could be used for further 
deve opmen at the state or local level. Development . at the oca level (or. 
through regional consortia. of school districts) is particularly a tractive 
beSe 0? its potential for Closely coupled i^^Plenientation efforts in local 
school districts. Appropriate inservicfl education and local leadership, n 
combination with the curriculum development endeavors, greatly increase its 
potential. " . 



Facilitation of Objectives »1, #2, and_#l 

The thrpe categories of interventions presented here are intended to 
foster attainment of objectives #1, #2, and #3 as described^previousb;. 
Obviouily interactive, because of their orientation toward facilitating the^ 
effect eness of othe^ interventions, these categories must be considered n 
light of their potential impact when combined with other interventions. They 
can be initiated at various levels and be either short term or. long term, 
although, they tend toward long term. 

Improving Loca l Leaders hip. As single interventions, none of those 
inclu ffd in t^e category of ll^iFroving local leadership received a rating above 
ow n effectiveness' On the other hand, the/esearch cited earl le on 
affective schools and implementing change indicates quite strongly that this 
' local eaderh?p is an essential ingredient that must be present if o her 
nterventions a-re to have the desired effect. ThTTTeadership probably will 
omrfrSrpe^^^^^ a variety of roles within the school d strict. Whether 
this leadership is provided by science supervisors, general curriculum 
Sirectors! princi-pals, or som'e combination of these persons, local sc ool 
districts must give it high priority. When it islnot present, federal and ^ 
sJa^e agencies should channel resources toward providing the needed talent to 
"protect their investment" iti other interventions they initiate. 

TP5tina o^on^-^-- 'his intervention is interactive in the sense that it- 
can brhnt^'^Ttr - ,d to changing the curriculum. Thus, it is, closely tied 
to objective #3 concerning the appropri atepess 'bf the curriculum To whatever 
extent nei curricula are adopted v.Uh a somewhat different content than in he 
past district testing proqrams assist their acceptance by including test 
item; consistent with the new curricula.^ It is an important sep for local 
school distorts (or Uates in those cases where they have state testing • 
n^oa?ams to take .in support of curricular change. It is a long-term endeavor 
i^ thafthe focul of testing programs rarely changes rapidly and changes which 
are made'can be expected to persist for' some time. 



Public Education. This category of intervention is interactive with the 
other s since pub I ic"o 'pinion and taxpayer decisions are the base upon which 
American education is built. Without public support for improvements in . 
science education, little improvement is likely. As a ca,^egory of 
interventions, however, it is not as prominent as most. To a large extent, 
the people who wish to imprbve science education in this country are not in a 
position to dramatically change public, values. They must proceed mostly on 
the basis of the values society currently holds. There are important steps 
which can be taken to educate the public, of course, but they will more likely 
arise out of a brdader context of concerns rather than from endeavors designed 
to directly improve science education. 
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Chapter 5. Recofumendati ons 



' Having dealt with the costs and effectiveness P?^^"^;'^.,. .^p 

: riaU n i h a i e^ on^ coufd^b: implemented, all point fo the need for 
fur her jud me ts. Such value judgments are the core °^ ^his ch pter It s 
recognized at the outset that someone'else may make a somewhat different set . 

rhn rp^ ha«;ed on the preceding cost-effectiveness analysis. This . 
fnc.^hnftv no reason ho^^ to' back away from making the judgments In 
;?lw o) Ih^ ^Jtens've ?n;es?ment in the analysis up to this point, it would be 

^^^"rerj'l%a°sicVnsiderations enter into these -con^endations First, it 
i" ;is5ur.vd that the recommended interventions will be initiated in a 
nn^Hinlted manner Research findings cited previously substantiate the 
iSr ance orthis approach. While in .om cases a different intervention may 
be sub ?^tu?ed for the one presented, it must be recognized that failure to 
provide an adequate substitute may negate the impact of. some of the other 



'"^"Te"conlTt'7stlred that state or federal . level interventions will be 
initiated in a manner that fully recognizes the importance 

intervention is to succeed. 



A State Plan 

The focus of the re^mmendations presented here .is a state Pl^" °^/ction 
for ilS'ovfng science' education. Imbedded within it. are recommendations, for 

^°"\n"'view'o?'lh:'si?o;g emphasis upon local initiative , in the previous • 
analy s and the responsibi 1 ity given local districts in many s tes for 

-u^f ie^orsi J:Vor-rircar^cS2^o/ ^fr r; es;\o 

. Take essen?ially all of the cost-effective interventions if it had the 

' '^^""rbLicTason Tor ^ iniUauie is that states are constitutionally 

.tlL rLson is the qual ty of work that can be done in many arenas when 
.re oeoule nvolved from a variety of settings. Even for larger school 
■:, , • 'o t i e t m lations generally are a positive influence. A vision 
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fnr thP future qoals and alternative plans for action which reflect indepth 

present to i u actions, such as development of curriculum 

economy of ^" ^, " ' '^^J , pe? pupi cost can be strikingly different. 
'''''bu ;hf s 0 t i elderihip'come from the state rather than the . 
federa level ?he main reason is the current tide of events Across the 
country states are assuming growing responsibility for education As the 
^nwomlnt inrreases the federal initiatives that do develop are likely to 
Tsu^e a w ^ f,^,:,e,t. Another reason for state leaders ip |S 

ftsTreate? proximity to the local level, an important consideration n view 
f%hl ?mnnrtanrp of local initiative. A final reason for not depending, on 
jL^ral act on s fhe ap re t low probability that actions will be taken a 
that level n the in^ediate future having' the systemic orientation highlighted 
SythJ an lisis presented above. Strong leadership at the state. level appears 
0 have te greatest potential for significant improvement in science 



education at the current time. 



Key Elements of the Plan ■ _ 

While containing a collection of specific recommended actions, the 

and choose ,„,H. ti.P must be a dynamic. ongoing program in whVcA 

i..H.7^ 'rexe rcised -TrSi- form of c leT r-c u ? goals gngoing agses.ment of 
^n'rl^^oLunica TTP^^T^^ planning oca^ Jea^^ 

^1 ' fho rp^n iirrps a nd assistance n e eded by lor^l districts in ^^f j- . ^'^ 

■ ?hp Hp^irpd obiectT ^ T he desired approach is analog ous to that dr.scribed 

% a rlp tu^ ?or effective principals. All the detai s cannot 

h1 cnonod m.t ahPal of time The plans must be open enough and the 

program. . ^ . 

1 Provide funding and professional assistance to 'local school districts for 
* deve opi g local leadership and science education improvemen programs 

leading to attainment of the quantity, quality and appropriateness 

2 F^^d^thrimprovement of teacher education progr^ams including (a) the 
addition of more "hands-on" activities in professional education and ■ 

D) mo?e instruction in -the sciences which deals with its applications. 

3 ProvideVaining for local school district personnel on curriculum 

4' ?Krestrb^Senrorcons^ of school systems, universities and 

other groups within the state to engage in curriculum deTelopment.^ 
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& Develop new standards for the adoption of science textbooks that give 
greater emjhasts to the applications of science, (not applicable to 



1. 

8. 
9. 

10. 



6 p?i;ide information for local school board members on needed improvements 

iVvidrconfe'rencIrfor local sehool district testing personnel to assist 
them in developing tests that will give more emphasis to the applications 
ot <.c'ence and be consistent with local science curricula. , 
?nd the development of item banks, with test items on he applications 
of science knowledge, from which local districts can dr^w items. 
Provide awareness Conferences and publications for local accountability 
committee members which will Inform them of the needs of science 
education and describe means for improving it. . ^ 
Fstabllsh leaders hip for the above in er.ventions J^ich wi e ab e them 
To proceed in a coordinated manner wit h appropriate modifications as 
indicated by evaluation and communication with local educational . 
personnel. 

' The basic purpose of the above plan is to improve science education, in 
1 .cal school districts. The success of this state e*ndeavor willbe measured 
il e e ent to which local interventions are initiated fo ati^ grea er 
Quantity quality, and appropriateness of science instruction. ""The intent is 
to encoi^age the implementation of coordinated local pro-ams composed of the 
following interventions. 

»,« 

Objective #1: Quantity 
1. Increase high school graduation requirements to include more science 

than' currently is required. . ^ ^ 

2 Increase the homework required in secondary school science classes. 
3* Initiate actions to help teachers more fully utilize the 

instructional time available in their classes, i.e., increase 
, . "engaged time." 

Ob.jective *2: Quality 

4 Develop local programs of teacher recogni on, professional 
development, and improved professional env ronment. 

5 Improve teacher recruitment and selecti,on processes. 

6* Provide better supervision and evaluation of science teachers. 
1 Introduce improved instructional practices such as mastery learning 
■ or one or more other practices documented. by research to be 

8. Conducf ijservice education in support of the various interventions 

9. ?roII,idrimproved materials, equipment and facilities as- needed in 
support of the other interventions. 

Ob.jective #3; Appropriateness 

10 Initiate local,. curriculum development endeavors in elementary and 
. e ndary school science, either in individua /^^ll^^^^ricts 

districts when they are large enough, or in consortia of districts. 



FaciHtation 

U Initiate improved program evaluation In local school districts with 
' ' particular attention to the appropriateness of goals, the degree to 

which 'they are attained and means of improving the science programs. 
12 Initiate additional supervisory assistance for science teachers 

which is focused directly on the improvement of instruction. 
13. Initiate careful selection procedures and professional development 

for principals. 

The state endeavor also is related to possible federal interventions. 
Existing federaV programs should be viewed as possible sources of support for 
activities included within the state plan or the endeavors of local school 
districts. In addition, state personnel should seel< to influence emerging 
federal programs to focus upon the interventions shown by cost-effectiveness 
analysis to be valuable for the systemic effort being fostered by the state , 
plan. Specifical/ly, the fbllowing federal interventions should be encouraged. 

1 Provide inservice "institute" classes for science teachers which 
'* (a) update teachers' l<nowledge in science, (b) assist in the 

implementation of new science curriculum programs in local school 
districts, and (c) have an integral relationship to local school district 
science education improvement endeavors. 

2 Fund science curriculum development projects with particular attention to 

' those emphasizing the applications of science ^nd focused upon the general 

3 Fund^the establishment within states of consortia of school systems, 

* universities and other groups to engage in curriculum development. 
4. Fund research worl< which will increase the l<nowl edge base needed for 

(a) curriculum development of the type described in #2 above, (b) careful 
, analysistof the problems of science education, and (c) identifying the 
actions needed to improve it. j r .. 

5 Provide an awareness conference for test publishers on the need for, new 

* science tests giving greater attention to the applications of science. 
6. Provide funding to sustain state programs as described above. 

In. mal<ing the choices required for developing the above recommendation, 
cost has been considered, especially in terms of tne cost to the taxpayers. 
-It has been calculated in terms of the impact on the average total annual 
expenditure per student. These data differ from the information provided 
earlier in that the previous information was expressed in terms of the average 
annual cost per student benefiting from the intervention ; the cpsts presented 
below have h £-.n ". nrpad across" afl student s in a district , including those 
' who do not benefit from the particular intervention. Thus, for example, an 

intervention costing $13.00 per student and affecting all students in 9th 
'grade, but only this grade, would, when "spread across" all thirteen grades (K- 
■12) result in an increase of approximately $1.00 per student in the average 
annual district per pupil cost, of education. Similarly, a federal expenditure 
of $41 000.000 would represent an increase of approximately $1.00 per student 
in the'average annual cost of educating all U.S. Students since there are 
■ rpprSxim ?elf 41.000,000 students in the U.S. Some interventions ;;ec«nde 
here would be valuable for students other than science students; , extending the 
proposed act-ion to, all students, of course, would increase the average annual, 
per pupil cost of education. 
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interventions ^"-ibed above are .sU^ated to l-rea.e the^avera,e 
annual per pupil cost "^S^.^-fhe tota Ms Ss'eS p^r pupil per 

^SrJetim^Jf'tSelfcotl J"ciiati5ns'ar: provided In Table A.3. In . 

the Appendix of this report. effected substantially if one or 

..The above total per pu lew d e e^^^^^^ ^„,l,ded. such as 
more promising but rel<itively cost y intervene o curriculum 

extended year contracts "r falaries forscience teachers to fpake 

"^X"^^^ a^a'co^l-S ^ectlve way to initiate a pro.-slng 

''''T^rfoXTol sSoS^d"br,f;er;t:°"addit.onal suppo^^ 

t,,e aiove progra. The P"9[r„Srt 'ef'fec??', f 1 t a « 'Jtrihe con-.<t 

.■^IX^'^'^Zr^^^^^^'^ tS%tart tSan'how far to 



A final Word About 
a Systemic Approach 



The Importance "f.vlewlng the a.ove reco»endaU^ 
than a listing « 'J '"^ ° Lp or b tJ^research on effective 

overemphasize. J'"^ P^'^=P!"lnn„ai chanoe reviewed earlier. It also is 
schools and implementing educational Change ^^^^„ce for high 

supported by the ana ysi. ore ent 1 e . ^^^^^^^ 

school graduation, ^O'^^^^'f'^' nntpntiallv serious problems. This 
appropriateness of the curriculum^^ the current 

requirement would affect "mostly tne non '^"''^y . for the college-bound * 
senior high school curriculum basically is dejnedro^ Requirements, 
student. Curricular change is "f dfd/l°"9J J^g^l J J ence instruction 

The question of wha 9031%^;°"^,^^ '"Evetvone ^"^.^i.^d with science 
permeates the ertire ana ysis oft ^his report Everyone nv ^ ^ 

instruction in the sc oo s mus g ap 1 . yet the 

applications of science need ^^Q^^^ioH JhU Soortance. The issue must be' 
significant minority are no Pe'-s^jded °f this ^^P°;tjn^^-,, be struck based, 
debated and whatever the outcome f t^^^^ebate. a course^^^^^ 
- on clearly understood goals careful y deve o^^^^ plans- into 

pursued wHh^optimism.^ ^^^^^ Thln^^ ^If ^trprrtl ' "Nhe costs 

described above i^^^S^f ^"f >J1 'n a ^seHous c^^ to improving 

^^fe^ie^edfcrt^on:^ If Sfsts^ ais^lu^^^y^.^s^ H reduced even further, however, 
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•he total should be scaled down somewhat rather than eliminating some parts. 
:t i s impe rative that a systemic approach be maintained. 
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PART n. MODIFICATIONS OF THE ANALYSIS AS IT 
PERTAINS TO MATHEMATICS EDUCATION 

AUhouah both science and mathematics are of concern for this analysis of 
vh. .5 wnst-effective means of improving education, the first and by far the 
the most cost-effective mea s h , ^^^^^ science. While it would have 
largest section of this "^^P^^t aea is or .y . ^ which combined 

been Po^sibeo report ^e^^.^'^the wo fields have been separated 

^'"^"^i; this part of the report, the previously presented analysis Jor science 
A 15ii hp rpvipwed with specific attention to the ways in which the 

simply unknown. 



Single Interventions for Improving 
Mathematics Education 

The single interventions for improving education will be examined 
individually within each of the eleven categories in order to identify 
differences between mathematics and science. 



Interventions Primarily Related to 
Objective #1: Quantity 

Thp interventions related to this objective all are in the category of 
increasln t^Se requirements. None of these interventions ^^^^bject 
necifc in other words, the analysis presented for science pertains to 

recommendations presented in a later section. 
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Interventions Primarily Related to 
Objective #2: Quality 

1 . Preservice Preparation of Teachers 

In most regards, the situation for mathematics is similar to science. 
niff«i«nrprarise with respect to the nature of the intervention and the 
? Jtext in w i? mp emented in a few cases. The cost of in tia ing 
a?eater matnematics requirements in the preparation of elementary teachers is 
^Hentially the same as for science, but its effectiveness potentially is 
differen In contrast to science, mathematics generally is S^^en major 
. IlnHnn* in the elementary school curriculum and actually is allotted as much 
t me y te h a Th schedule would indicate. Thus, there is little reason 
Uthi^kt^at a better mathematics background would result in teacners 
teaJh nq it more. In general, a better background in the given subject field 
Se it sdence! m;thematics or some other field, is desirable, but there may be 
less evidence of its importance in this case than in the case of science. 
SimilaHy the analogue of more college courses emphasizing the app ications 
■of science would be courses emphasizing the applications of mathematics. nia 
'? teo/enUon also is related to objective #3 concerning appropria eness. It 
s not c ear that there is need for college courses emphasizing the 
lpp^?cations of mathematics, but the more general curricular issue will be 
addressed later with respect to objective #3. 



3. Enhancincj Teaching as a Career 

The analysis presented for interventions designed to enhance teaching as 
a career hSlds for mathematics teachers as well as science teachers. 

3. Improving Instructional Practices 

The analysis presented for improving instructional practices also holds 
for mathemat cs as well as science, but in either case there is less 
.npcificity n this analysis than the previous one concerning enhanc ng 
^«!rhina as a career The second intervention in this category, mastery 
?p^^n no was in essence a place holder for a large collection of potentially 
^ 'iJ tr tiont^ rac?ices. Because of the di^^r^^^Hona %?a'Sce° ' 

forgi??en: Interventions of this type have significant promise. 

4. Inservice Education of Teachers, 

There is little in the analysis of interventions concerning jnservice 
educatJon that would be expected to be different for mathematics than for 
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science While the evidence cited for the indifferent record of summer 
n tuSies was fron, the area of science, there is ittle reason to expect the 
evidence in the area of mathematics to present a different picture. The 
tnie^Sent on regarding the applications of knowledge in ^he curriculum raises 
the same issues about the goals of education mentioned earlier and will be 
addressed more fully below with respect to objective #3. As in the case of 
science! thelystemic nature of the situation must constant y be borne in 
m.nd the intervention describing inservice education coordinated with local 
S^IeioSmenJ enSeavors is especially attractive and will be considered further 
when comoinations of interventions are addressed. 



5. Improving Mathematics Materials^ 
Equipment and Facilities 

As a single intervention, the analysis is similar for both science and 
mathematics with the exception that the costs of non-text materials is 
substantially less in mathematics than in science. Even more than in 
science, the addition of materials apparently is not the most critical factor 
in improving instruction. 



6. Industrial Assistance 

With the exception of donations of equipment, the analysis of this 
category of interventions is essentially the same for "Mathematics as for 
^rience Even in the case of equipment, the situation is not that d fferent 
in that'the donations of equipment available often are not that usable or 
appropriate for instructional use. 



Interventions to Attain Objective #3: Appropriateness 



This objective and the related category of interventions, improving the 
curriculum differ more than the others from science to mathematics. 
App^opHaU goals of instruction are highly related to the particu ar subject 
field. In exploring the question of appropriateness with respect to 
mathematics, two findings from research are particular y significant First, 
asin the case of science, the research establishes quite clearly that the 
mathematics curriculum in the schools is defined by the textboo s in use 
Teachers teach whatever is in the textbooks. Secondly fjj;;"!' J^/"/'' 
case of science, is viewed as important for preparing for the "f ^.l^^^J 
schooling, not because it has become a direct value in and of J^self. At th s 
oin? the'analysis may part company, since what makes a ^° ' 

npr<;nn mav varv consTJerab y from one field to another. In science, ror 
example! the [ase was made that personal applications of the ^nowledge and its 
Sication to various societal issues should have more of a bearing on what 
science st.2ghrn the schools. In mathematics the issue may be similar i 
one Jesps't; it may be valuable to teach students more directly the use of 
rtheSicSl knowledge in personal applications. In ano he, ,esp^^^^^ 
be quite different, in that mathematics may not be a? overtly a part or ine 
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lJh!LJ rAl knowledae is of most worth in the curriculuiri may take a 

^ alloied loThape the curriculum even if it means the curnculum is 

"'''A^noied previfu^ly with respect to science, this category includes two 
,enera tjpes o nterventions. The first directly addresses Pf^t'cuar types 
gef the curriculum; they are based upon value O^jJ^^^" .Jl^ 

f the curriculum is assumed and the question becomes one of assessing the 
Mlue of particular mechanisms for producing this change. . , 

The fir^t three interventions in this category deal with particular 
-hanaes i t e S ten of the curriculum. The costs are basically the same as 

[rf H-e^^ 

0 Th p 0 c nd win no! pursued here. Suffice U to -y that the 
dph.tP ircritically important and should be pursued vigorously in the 
tfteJesJ of prov d ng a sense of - direction for mathematics education 

?hP othe? interventions in this category pertain to mechanisms for 
hrinoina about Jhe des red curricular change. The analysis is essentially the 

consideration for potential interactions. 



Facilitating Interventions 



The farilitatina interventions are not very subject specific; the 
analvlis ore e teS for scie ce can be used essentially as is for mathematics 
^^cn^ AlSost all of the facilitating interventions are highly interact ve; 
y'caS be add ssed most readily in the following section on combinations of 



interventions. 
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r.omblnations of Intervent ions for Improving 
Mathematics Education 

specific nature. 



R e c oniTie ndations 



inSkated above), and costs essentially the same. 
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PART III A DELPHI STUDY OF LEADER'S VIEWS OF INTERVENTIONS 
FOR IMPROVING SCIENCE AND MATHEMAYICS EDUCATION IN COLORADO 

,s a supplement to the ccst-effectl veness -jJf,;^,^,r^elSeJs^ in'gilorado 

"eport. a series of ^^^^^^f "jl ".Jfc rren sta^ of science and 
to determine their opinions about the current sia^^^^ ^^^^^ 

nathematics education ^%^„^e ^^3% 'e^to a a D Iphi study, the series of 
about positive change. Sometimes ^^terrf ^0 as^ in which information from 
quesfonnaires was designed ^V,J"/^Jf ^.J^' ..K^^^ to the respondents for 
previous questionnaires is ^'^'^^^^^^^J.^^l^f^ir^^^ opinions of others 
fheir reaction . ^PJ^^^J^,^/ / J .^^^^ TormiSg their 

and potentially be intluencea °y r achieving some consensus, 

conclusions. The process has he po f of J^^^^ving ^^^^^^^^ 
somewhat as in a group discussion without the poss .^.^ ^^^^i.g 
ilinl^eS^i: ^Sfcfursl/rt Crhrpoien^ral^ri ntify?ng areas whe.e there 
rl^avS: ^^^^'^.e.. respect to 

four main topics. 

. What are the major problems with science and mathematics education, 
SSatToaulSoJirbe'ru^Led in science and mathematics education in 
Sl-r^cU^onfJartSe'^trnErarof improving science and mathematics 

S'hat'arrJhe perceived costs and effectiveness associated with the 
various actions under consideration? 
The opinions of eight categories of people were sought as follows. 

1. Superintendents and orincipals 
2' School board members 
3! Curriculum directors and supervisors 

I: r^kcftfof rers^nSr;rSrs!Jators and science and 

mathematics professors) 
7. Colorado OeP-tment of Education personn^^^^ ^^^^^ 

llrau ES";rioi^oS«e«"and1?ate Board of Education members) 

This endeavor sought the opinions of lead|^ in ea^^^ °U::rnSm?nft5on:- 
not a cross section of '''''V''""'^'^- .'^^'^'nofexample the superintendents 
of leaders in "^';.""9°ry were t e ;,?',//4"P;^;,Houe ?rofesssional 
and-.principals ""'acted "^^=,"9", ^avino an informed opinion about 

ffsS^ctlS ^r5h^?J^ree?s:^ef?rrtrSrrr:a5l inrcL^e people from the various 



2. 
3. 
4. 
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geographic regions of the state and froni various types of settings, stich as 
urban and rural. ^^.^^ participants was developed a letter was sent 

Th^ fir^t of a series of three questionnaires. . . . 

\t lioroafh fo iSwed allowed for followup of non-respondents to the 

Vrm the qSestionr.ire '"'''"ting that U also ad b ™a ed 0 y 



Questionnaire _H 

The first questionnaire contained only open-ended questions ten in 
„„™h;"wJ;j Vh respo^ 

^th tjuMo' ?hr;"eroh eru.e.. schoo, b'oard ™e™ber. teacher. 

; rt;n^:^^ ofc ) The resDonses are summarized below, 

::MB^m¥^BB!B^^^ ^^^^ 

°' ''3S^:i;.ed how ,ood a jo. U be1„, ^^one in science a„d^^athe.atics^^^^^__^ 
education as compared to °'Jf areas or scuay n . j^e doing 

thought it wf„ 'be same w . e Pr 5'^ate y^ 0^ ^ 

Zlllu ^tS"3rff"en«?r;ea slight.. ?he responses indicate comparatively 
''''%Zr{lZZ !3e:m5llrg"rps"o/siSS nU in the schools are being 

jesni.re;st;|Jt;j-£^^^^^^^^ 

be ;fate? a t " -le 1 tSa^'at the'higher l^Sels. Minority students 
and'?|male students were cited by son« respondents as groups poorly served. 
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Some respondents identified the "general student as the one mst poorly 
served while a substantially lesser number referred to the '^academic" student 
as the group most poorly served. 

When asked to describe what ':he goals of science and mathematics 
education should be, a wide variety of responses was received, but a pattern 
emerged. Respondents saw distinctions among groups of students, most often 
noting a distinction between two clearly identified groups of students. One 
group, sometimes called '^ac ademic ," consisted of those likely to go on to 
colleges, often to major TrTr.clence, mathematics, or engineering. There 
appeared to be a general consensus that the primary responsibility here is 
providing a challenging college-preparatory course of studies in science and 
mathematics to enable these students to compete and succeed in college. 
Another group consists of those students unlil<ely to pursue such rigorous 
collegiate courseworl<, but who will constitute the majority of our future work 
force and citizenry. This second group was sometimes designated as the 
" genera ^" student. Many respondents believed the primary responsibility 
towards' Chi s group was teaching them those aspects of science and mathematics 
most likely useful in their everyday personal lives, and also to prepare them 
to be sufficiently literate about science and technology for their role as 
voting citizens. 

When asked what would most improve science and mathematics education, a 
large number of different responses was received. Within this lengthy 
listing, however, the most frequently mentioned responses pertained in some 
way to teachers. When the responses were placed in categories, the most 
frequently mentioned were higher quality teaching, higher salaries for 
teachers, and improved teacher preparation. 

The respondents to this questionnaire also were asked if the school 
district by which they were employed (or if not an employee, the district in 
which they resided) was likely to spend more money on science and mathematics 
education to bring about some improvement. The majority of respondents had an 
opinion on this matter, and of those who did slightly more than half said 
"no"; approximately one-sixth said "probably," and the other one-third said 
"definitely" their district would spend more money. 

While these general responses were helpful, there were two areas needing 
further attention which were pursued in the subsequent questionnaires, namely 
further information about the goals which science and mathematics education 
should pursue and the particular actions or interventions which are most 
likely to bring about improvement in the current situation. 



Questionnaire #2 

Based substantially on the response to the first questionnaire, a second 
was developed which was more structured and focused upon three major areas. 
It began with a description of the distinction noted above between " academic " 
and " general " students. The respondents then were asked the amount of change 
they tel t was needed in school programs to meet the needs of these two groups. 
The structured question made distinctions between science and mathematics and 
between elementary, junior high/middle school, and senior high school. The 
results of this query are summarized in Table 4. It is clear from these data 
that the vast majority of respondents felt that change was necessary, but 
moderate change was more attractive than major change. 
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lalile i\ 



Ihe Amount of Cliarige Needed in the Science drid Mathematics 
Education of Students As Rated by Colorado Leaders 



Superin- Curriculum Higher 

tendents School Directors Voca- Educa- 

Categories I Prin- Board h Super- tional tion ecte 

of S udents cipals Members visors Teachers Educators Personnel CDE Staff Off als a 

(6) (18) (U) (25) (6) (19) (6) W W 



Academic Students 



EleffinUrySci. 1.22 1.22 0.93 1.61 1.00 IV 1.60 1.25 Uj 

ri._„i.'u,u. 111 in n 7Q no .nn 1.22 1.40 1.2b i.il 



rsc'r'" i;H m m i.^ i.n 1.27 uo uo ue 

Jr.Hihlath. 1.11 1.50 1.00 l.M . . • . . 

Sr.HihSci. 1.06 1.39 0.85 1.36 . . . . • 

Sr. High Bath. 0.94 1.39 0.64 1.32 0.83 1.53 1.33 1.75 1.21 

Ganerai Students 

EtatarySci. 0.89 1.11 0.?9 l.2« I'll I'f. I't 1« 



^m. U2 m in m ui 0.95 1.20 1.00 0.95 

Jr.HighSci. 0.94 1.28 1.21 . • • . • . 

Jr. Hi h Hath. 0.83 1.40 1.07 . • • . • . 

Sr.HihSci. UO 1.46 1.36 . • . . • • 

Sr. Hi h Hath. 1.00 1.39 1.43 1.36 : 1.00 1.27 1.33 1.75 1.29 



Major Change = 2 
Hoderate Change = 1 
No Change = 0 
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Tho c^rnnd section of the questionnaire dedU with the Importance of 
The second section o^^"^^ ^ niathematlcs education. The 

ZZl To n'clu u staSd5S of fundamental principles of science and 
IfIh«m.H?s oreoaHnq students to deal with science-related socleta Issues, 
JJp^.Hq students S apply science and mathematics knowledge In their 
rvefySly 1 es! and giSg students a better understanding of science- and 

«tf uJpri rareers The responses to this structured question are 
CO aT ^ e 5' o"' The most'strlking conclusion that comes from this 
table is that, although there are some variations, seemingly everything Is 

'"^^'^he'^hlrd part of the questionnaire contained a detailed listing of many 
possible actions or Interventions for improving ^c ence and . at e^^^^ 
r!A„r;,f\nn These Intervent ons were derived from the results or tne Tirst 
nfiPs? inn^ire as wel a other sources, and included most of the interventions 
a dre eS e sewhere n this report. Respondents were given an oppor unity to 
?Ate both the effectiveness and the feasibility of each of the specific 

terve 1 s. he summary of these ratings In Figure 6 below inc u es e 
Effectiveness and feasibility ratings of the total group of respondents for 
olrh of the eleven categories. There is variation in the ratings for these 
nJn^Ds 0 in?erventio more so for the effectiveness ratings, however, than 
Hhe f a b y atings. The highest effectiveness ratings were given to 
tSose intervention categories relating to teachers; they were rated 
aSSrox mate y m dlay between effective and highly effective. The lowest ratea 
t ?:e:?iois, testing programs and j^PJ^ved leadership were rated 
approximately midway between somewhat effective and effective. 



Questionnaire #3 

The third questionnaire contained two parts, both built upon information 

?n m.P.tionna re #2 generally thought all of the various goals were important. 
?Sp^arpa maiirity were ra ed in the mid-range between important and very 
The great "^ajonty were ^^^^ . ^ being rated important. None were 

S r d : h y mSorUn? rSnVorUnt. The questionnaire then went on 
5n raise some questions growing out of these judgments and some data about the 
curre science cuiculGm in the schools. It was noted that the current 
inninr and !e"or high school curriculum (whether for " academic " or "aeneral" 

ude t cont 1 s i tie on societal Issues, personal apoTTciT ons or career 
nrpoarat on Several studies using different methods consistently show the 
Tame el?;. The average amount of actual instruction time "science 
classefdevo ed to all of these matters combined is in the ne ghborhood of 
5 Sercint! This instructional time is pTopoFTTonal to the jtten ion g ven 
these top cs in the current textbooks. There is an apparent contradiction 
these "P;"„„','"^.--u5Pd ky the respondents to th s questionnaire and school 
fac?lJe''% e Snaire'thSn wenf°on%o raise the>ollow1ng question w th 
?es5ect to the "academic" students to which the respondents were expected to 
respond in an open-ended fashion with their comments. 
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Table 5 



Average Rating of Various Goals for Science and Mathematics Education 
by Several Categories of Colorado Leaders 



Superin- Curriculum Higher 

tendents School Directors Voca- Educa- . 

«. Prin- Board & Suoer- tional tion tieciec 

Goals ci SSers \isSrs Teachers Educators Personnel CDE Staff Officials o a 

(18) (18) (14) (25) (5) (19) (6) (4) (109) 



lamental Princi - 
i of Science & 

Students 2.72 2.75 2.82 2.80 2.40 2.79 2.33 3.0 2.74 

ineral Students 2.56 2.38 2.36 2.48 2.00 2.42 2.17 2.25 l.W 

;nce Societal 

iemic Students 2.50 2.38 2.36 2.76 2.20 2.26 2.33 1.25 2.41 

;neral Students 2.28 2.29 2.36 2.64 2.20 2.16 2.33 l.bU 

sonal Applications 

iSfstudents 2.5 2.06 2.15 2.44 2.00 1.79 2.00 2.. 2 18 

aneral Students 2.39 2.28 2.36 2.56 2.40 1.63 2.33 d.d^ 

sonal Applications 

E^r^Hdents 2.50 1.9A 2.53 2.28 2.20 2.05 1.83 2.75 2 24 

eneral Students 2.72 2.61 2.84 2,66 2.60 2.26 2.33 

eers— Science & 

hematics Related ^ ^ ^ r.r. P cq 2.24 

cademic Students 2.22 2.17 2.53 .28 .0 .0 .00 .0 

eneral Students 1.72 2.00 2.15 2.00 2.40 1.58 1.83 ^.^s 



= Very Important = 3 I = Important = 2 SI - Slightly Important = 1 U = Unimportant = 0 
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Effectiveness 
(Highly Effective) 3.0 



2.5 



Enhancing Career 
Preservice Preparatio^ 
Inservice Education 
Improving Instruction 

Increas. Student Requirements 
Improving Curriculum 



(Effective) 2,0 

Business Assistance 



Improving Materials 

Public Education 
1.5 

Testing Programs 
Improving Leadership 



(Somewhat Effective) 1.0 




Feasibility 

3,0 (Definitely Feasible) 



Preservice Preparation 

Increas. Student Requirements 
improving Instruction 
improving Curriculum 
Jnservice Education 
Publ ic Education 
Business Assistance 

(Enhancing Career 
Testing Programs 
Improving Leadership 
Improving Materials 
2.0 (Possibly Feasible? 



1.5 



1.0 (Possibly Infeasible) 



Fiqure 6. Ratings of Effectiveness and Feasibility of 
Intervention Clusters by Colorado Leaders 
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Current 



"Would you advocate modifying the c^-^-^i^ulum to take care of this 
discrepancy? If so. in what way , to what extent, and wh^? 

It then was noted that enrollment figures show "general " students 

"Is this problem one that requires change in the science curriculum? If 
so, in what way , to what extent , and whj^?" 

The responses to these two questions were categorized and a'-e summarized 
in Table 6 In general it can be said that the respondents see a need for 
hanae in the curriculum for " academic " students by a margin of approximately 
three tJ one! A need for chan ge in the "orientation of the curricu um for 
" SeneraV ' students is also favored, but the margin is less, not quUe two to 

Even more insight is gained from the reasons contained in the comments 
m.Hp in JesSonse to the open-ended questions. There was considerable 
nnlfnrmuv in the rationale given by the respondents in each of the groups. 
The!? rltionalf prSJ de^ mportan dues as to the nature of the debate over 
ISience ed ca o'n goals and'clearly indicates there is a definit ve 
^oiirn us as to wh t t-:- orientation of the curricu^ ^^^^ 

^r^J fn'lhf u t'b-,e^cl^ ^^5^ ^^^^^JJeir 

i-rtiSnedratThrcSrn^i rh^trn^ot^be^Er ru^h!^ ^feL-;; 

instruction needed to be more related to life, but they were looking for a 
iSdrficaUon to the existing curriculum, not a wholesale replacement with a 

'°'^^|i;e'mwrt; rresSS^dents who felt the curriculum should not change 
were convinced sLch changes would "dilute" the curriculum and that subject 

feU that science-related societal issues should be addressed ,n social 
<;tudie<; rather than in science classes. . i-u ^^^,4 ^r^y. 

?he Reasons given for the answers to the question about the need for 
chance in tSe Curriculum for " general " students reflected values s mi ar to 
tho e e pr ssed above. The mafelTwho felt a change was ed 
curriculum argued that it needs to -/^^f^^^^ ^ ^ f^m i'r lnce of 
have more of an experiential base. They were P«i:^"^^^° ^^ould 

exploration of scientific phenomena. 
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Table 6 

Opinions of Colorado Leaders as to Whether or Not 
thr^ Science Curriculum Should be Modified to Grve more Attention 
to Personal Needs, Societal Issues, and Career Preparation 



Academic Students 



Yes No 



No 

Response Total 



General Students 



Yes No 



No 

Response Total 



Supts. & 
Principal s 

School Board 
Members 

Curriculum 
Directors & 
Supervisors 

Teachers 

Vocational 
Educators 

Higher 
Education 
Personnel 

CDE Staff 

Elected 
Officials 

Total 



11 
13 

9 
9 



11 
4 

3 

63 



2 
5 

4 
3 



4 
1 

1 

20 



2 
2 

2 
4 



1 
0 

1 

13 



15 
20 

15 
16 



16 
5 

5 

95 



9 

8 

9 
7 



9 
4 

2 

51 



4 

8 

2 

6 



5 
1 

2 

28 



2 
4 

4 

3 



2 
0 

1 

12 



15 
20 

15 
16 



16 
5 

5 
95 
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''"I^Scond'rf trthe1h1?d''qSfationnaire provided another opportunity to 

. ?K! i?!=rfi»LeL and feasibility of various interventions. Only the 
"o e h fra 1 t rreStions fro, Ue previous J^estjonnaire were included 

"iH^a ?e'%Sr?n?Sj;2n?fonrfrSr?.rsS : included the 

questionnaire. 1^?=^.';""?" " previously used categories. Uhen presented 
irfM 'fhtfd S i nlfre 'rhfv^^rour^^gle intervLtions witM^ 

i:,T^o% were listed j" the order of t|;f ^.Jtronr'bf "rls^ide^U 
row%rhrnr're ? i s" e° uestiJnSarre had an Opportunity to rate 
then, agarn!' \kl resl^.s of these ratings are su™,arued ,n T,.ble 7. 

Implicatinns of the Findings 

T>.n ;,^nprts of the findings of this Delphi study have particular 

°""'rherf irno?"a cleTr co~ll fhfde'J^d goals of science and . 
.athel r4 d^at 0 % si.^ 

'•''^i^ ^^n attention inThe cur^icSi™ to the applications of knowledge and 
tiosawhrbe? eve tsou5S focus almost exclusively on fundamental knowledge 
?I;Sepen5en?oJ applications. This difference in values see-s to pertain to 

^ 'i^addUi^n'^to S^UflSe^in values, consensus on the question of 
goals'^sl^; fct^ b, false assumptions ajojjt f ucationa prac ice in the^^ 

^?hriecond''i™Sikali'ol;Tihese fi„<iings is that mobilizing effective 
f j"a S £iHs1o1??Stve^2j?rfS^^ 

nll'T. m orvar?aUon"I^ong individuals, but even within various 
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Table / 



Ratings by Colorado Educational Leaders of the Ff recti veness of Various Interventions 
for Improving Science and Mathematics Education 



Superin- Curriculum [higher 

tendents School Directors Voca- Educa- 

' h Prin- Board I Super- tional tion Elected 

Interventicfls cipals Members visors Teachers Educators Personnel CDE Staff Officials Total 

(13) (18) (14) (12) (3) (16) (5) (5) (86) 



1. Preservice 
[^reparation 



a; New standards 


2.31 


2.33 


2.21 


,2.42 


2.67 


2.44 


1.80 


2.60 


2.34 


b. Greater sci . & 




















fliath. for eleni. 




















teacher 


2.47 


2.61 


2.29 


2.42 


2.00 


2.32 


2.40 


2.60 


2.42 


c. More courses on 




















applications 


2.39 


2.22 


2.36 


2.92 


3.00 


2.06 


2.20 


L80 


2.34 


d. SpecialiiJ 




















prep, for 




















grades 4-6 


2.01 


2.56 


1.72 


2.50 


2.67 


1.94 


1.60 


2.20 


2.14 


e. More "hands-on" 


2.62 


2.34 


2.22 


2.50 


3.00 


1.94 


1.80 


1.40 


2.25 


f. Loans or 




















scholarshiDS 


2.55 


2.05 


1.86 


1.83 


1.65 


1.81 


2.20 


1.60 


1.99 


g. Stronger enforce- 




















ment of full 




















credentials 


2.01 


2.22 


1.79 


2.17 


2.34 


2.25 


1.80 


1.40 


2.05 


h. Student teachers 




















with outstanding 




















coop, teachers 


2.38 


2.39 


2.57 


2.33 


2.67 


2.19 


2.20 


1.40 


2.31 
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Table 7 (continued) 



1^ 



Superin- ■ Curriculum Higher 

tendents School Directors Voca- Educa- 

l Prin- Board & Super- tional tion Elected 

Interventions cipals Members visors Teachers Educators Personnel CDE Staff Officials Total 

(13) (18) (14) (12) (3) (16) (5) (5) (86) 



2. Inservice Educ. 





? 07 


2 17 


2 11 


2 42 


2.33 


2.31 


2.00 


2.25 


2.23 


Inservice 




































2.20 


2.23 


applicfttions 








9 


Coo 


2.13 


? 20 


L, Inbci V ILc lUUi Ui 




















with local 
















1.80 


2.02 


enoeavors 




9 11 






2 33 


1 67 


1.40 


d, Teacher centers 


1.51 


2.11 


1.6.4 


2.00 


1.98 


1.56 


1.40 


2.00 


L79 


e. Improved teacher 














1.60 


2.60 


2.09 


evaluation 


2.15 


2.45 


2.14 


2.08 


1.98 


1.63 


f. Inservice on 




















higher level 










1,33 


1.44 


1.40 


2.20 


1.59 


sci. & math. 


1.54 


1.95 


1.46 


1.33 


g. Extended year 
contracts , 












1.94 


1.60 


1.60 


1.85 


1.54 


2.00 


1.79 


2.00 


2.33 


h. Academic year 










2.67 


1.69 


1.80 


1.60 


1.86 


institutes 


1.84 


2.17 


1.64 


1.83 


i. Late afternoon 




















or evening insti- 












1.62 


1.60 


1.20 


1.67 


tute classes 


1.77 


1.89 


1.14 


1.92 


2.67 


j. Inservice on 












1.31 




1.20 


1.48 


teaching methods 


1.47 


1.56 


1.64 


1.25 


2.34 


1.60 


t Sabbatical 
















2.20 


1.83 


leaves 


1.23 


1.65 


1.93 


2.33 


1.98 


1.88 


2.00 



Table 1 (continued) 



Interventions 



Syperin- Curriculum Higher 

^endents School Directors Voca- Educa- 

i Prin- Board h Super- tional stion tiectea 

cipals Members visors Teachers Educators Personnel CDE Staff Officials Total 

(13) (18) (14) (12) (3) (16) (5) (5) (86) 



3. Enhancing 
Teaching as 
a Career 

a. Increasing 
salaries for 
all teachers 

ti. Other incentives 
for teachers 

crimproved profes- 
sional environ. 

d. Increasing 
salaries for sci. 
& math, teachers 

e. Teacher recogni- 
tion 

f. Performance pay 

g. Collaborative 
research 

h. Improving 
teacher recruit- 
ment 

i. Reduced work 
loads 

j. More emp'i'isis on 



2.07 


1.94 


2.14 


2.67 


1.50 


2.56 


2.00 


2.60 


2.24 . 


2.24 


2.28 


2.07 


2.33 


2.00 


2.28 


2.60 


1.80 


2.23 


1.76 


2.28 


2.07 


2.50 


1.50 


1.75 


1.40 


2.40 


2.03 E 


1.54 


1.65 


1.85 


2.33 


2.50 


2.38 . 


1.80 


2.20 


1.97 


2.09 
1.62 


2.28 
2.11 


2.00 
1.43 


2.42 
1.33 


2.00 
0.50 


2.06 
1.81 


2.00 
1.80 


2.60 
2.60 


2.18 
1.71 


1.24 


1.59 


1.43 


2.20 


1.00 


1.31 


2.00 


2.00 


1.57 


1.62 


2.11 


1.64 


2.16 


1.00 


1.56 


1.60 


2.20 


1.80 


1.38 


1.65 


1.86 


2.09 


2.00 


2.00 


2.00 


1.60 


1.80 


2.16 


2.61 


2.22 


2.67 


2.00 


2.13 


1.60 


2.80 


2.33 
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Table / (continued) 



Superin- Curriculum Higher 

tendents School Directors Voca- Educa- 

iPrin- Board & Super- tional tion Elected 

Interventions cipals Hembers visors Teachers Educators Personnel CDE Staff Officials Tota 

(3) (18) (14) (12) (3) (16) (5) (5) (86) 



H 

H 



4. Improved Instruc - 
tional Practices 

a. Hastery learning 

b. Improved student/ 
teacher ratio 

c. Computer-asbisted 
instruction 

5. Increased Student 
Requirements' 

a. Increasing grad- 
uation require. 

b. Increasing class 
time devoted to 
instruction 

c. Increasing col- 
lege admission 
requirements 

d. Increasing home- 
work 

e. Increasing length 
of school day or 
year 

f. Increasing school 
days devoted to 
instruction 

Q. Increasing aca- 
FRTHemic req. for 

S^dthletics 0.92 1.61 1.14 l.bu "-^^ '''' ^•"'^ "'^122: 



2.24 


2.28 


1.71 


2.00 


2.67 


2.12 


2.00 


2.20 


2.10 


1.61 


2.11 


2.07 


2.36 


2.33 


2.UU 


1 fin 




? 0? 


2.01 


2.11 


1.79 


1.45 


2.33 


1.56 


1.40 


2.00 


1.81 


1.99 


2.22 


1.57 


1.90 


1.00 


1.88 


2.00 


2.60 


1.94 


2.16 


2.61 


2.29 


2.40 


1.67 


2.06 


2.00 


2.40 


2.28 


1.77 


2.39 


2.00 


2.30 


1.00 


1.81 


2.00 


2.60 


2.05 


1.39 


2.06 


1.64 


1.67 


1.33 


2.13 


1.60 


2.00 


1.87 


1.62 


1.61 


1.00 


0.90 


1.33 


1.63 


1.40 


2.20 


1.43 


2.07 


2.22 


1.79 


1.60 


1.33 


1.94 


2.00 


2.20 


1.95 


0.92 


1.61 


1.14 


1.60 


0.33 


1.50 


1.40 


1.40 


1.34 



Table 1 (continued) 



Superin- Curriculum Jjgher 

tendents School Directors Voca- E yea- 

I Prin- Board h Super- tional tion 

,„te.e.io. cjpjs «ers .jso. teac.rs E.cators Pe«e, CDE Staff Offjcu. Iota, 



6. Improving School 
Curriculum 

a. Developing more 

StS 2.50 2,30 2.00 IM 3.00 1.94 1.30 "3 

'iStlL 2.23 2.« 2.36 2.10 ^'^l 

c. Training for 
local districts 
on curr. dev. & 
implementation 

d. Developing more 
rigorous courses 

e. Developing model 
district curr, 
patterns 

f. Reducing "frill" 
courses 

g. Developing con- 
sortia 

h. Fe(5eral funding 
of new curriculum 
project 

i. New state stan- 
dards for 
textbool(S 

j. Revising "old" 



1.69 


2.18 


1.64 


1.60 


2.34 


1.50 


1.40 


1.60 


1.74 


l.M 


2.25 


1.64 


1.60 


1.67 


1.87. 


2.00 


2.60 


1.87 


1.77 


1.88 


1.86 


2.10 


1.67 


1.81 


1.40 


1.80 


1.84 


1.23 




1.72 


1.90 


1.65 


2.06 


1.80 


2.60 


1.94 


1.31 


1.88 


1.64 


1.80 


1.66 


1.56 


2.20 


1.80 


1.69 


1.31 


1.53 


1.43 


2.20 


1.67 


1.38 


1.40 


1.20 


1.52 


0.85 


1.12 


1.14 


1.10 


1.33 


1.50 


1.00 


1.00 


1.14 


1.23 


1.31 


1.21 


1.60 


0.66 


0.75 


1.00 


1.20 


1.17 



H 
H 



Table 7 (continued) 




Interventions 



Saperin- Curriculum . 
tendents School Directors oca- E c ■ ^^^^^^^ 

i 'r « r:> » - -sr" 'S 



J. Industrial 




















Assistance 




















a. Sumer intern- 




















ships for 
teachers 


2.09 


2.33 


2.07 


2.27 


^ An 

3,00 




? 00 


2.40 


2.20 


b. Lecturers & 
workshop leaders 


2.00 


2.33 


1.86 


2.28 


3.00 


1.94 


2.00 


2.60 


2.14 


c. Seed money for 
projects 


2.00 


1.95 


2.00 


2.37 


2.67 


1.75 


2.00 


2.20 


2.03 


d. Part-time employ- 




















ment (e.g., 
summers) 
e. Donating equip. 


1.92 
2.23 


1.94 
2.22 


1.79 
2.22 


2.28 
2.27 


2.67 
1.98 


1.81 
2.00 


1.60 
2.20 


2.20 
2.60 


1.96 
2'.20 


f. Assisting in 
evaluating curr. 


2.23 


1.94 


1.21 


1.64 


2.33 


1.31 


1.40 


2.40 


1.63 


g. Rotating 




















employees into 




















classroom 
teaching 


1.39 


1.18 


1.97 


1.50 


2.33 


0.89 


1.60 


2.60 


1.60 


h. Cash awards for 


















1.60 


professional 
development 


1.54 


1.45 


1.36 


1.90 


1.66 


1.44 


1.80 


2.60 



Highly Effective = 3 



Effective = 2 



Slightly Effective = 1 



Not Effective = 0 
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1 tp n orincioals or school board members), 

subgroups of educationa eader P^'^nd agreement on a precise 

most of these variations "ncei eacn o^"^^ context, action is often the 
course of action is no o,t „^^^ 

resu t o^//d%°^.,^^'tt^'st be expected that the process of arriving at good 
pontically. Thus, "I'^st expeu ^ efforts will be necessary to 

r^-^S^^o\ rr't^re^ s' f^effe^^^^^^^^^^^ analysis. The results of the 
ron^ralToce^s "ofLSrse shoul^^^^^^^^^ 

ra!tr?Se°ragrr e^^of^fhr i r rrocesfii?! S^ot override the results of 



sound analysis. 
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APPENDIX A. CALCULATING COST ESTIMATES 



AS indicated in the ^^-t chapter o, this report speclalists^^^ 

effectiveness ana ys s ^ g° ^ ^en" about what costs will be 

than a science. It Is a Process '"a^ ' « ^ ^ ^ the best 

involved in each case and malting f ^^^^J^^^fg^'J^J should not be considered as 
information available. But they are mates ana 55 

precise as some of the ^9";:"^'^^1°^,1?P^{- two significant figures; a more 
student should not be vewed as accurate to two signi . y ^ 

accurate way of expressing the mean ng of th s "nmaie 

confidence ^"terval . An n u 1 ve ud m^^^^^^ ead^o ^^.^ 

be better to say something like, we J'fe perce precision, of 

somewhat between $0.35 and ^O-^S Pf J'' The range of costs for 

course, is not a problem ^^^^^^^J^J^P^^.f^t pred on s not Seeded for one to 

the interventions js very Ij^Sf'^J^J.^^f J.^J^e ^effecti^ 

make comparisons of their costs "J^ °^ provided (Table A.l) as 

In the tables which follow, "st estimates Jl^e prov e , 
well as the basis on which they «jre calculated (Table A.^.^ ^^^^ 
there are several means of jstimat ng ^^Ich reappear at severa p ^^^^ ^^^^^^^ 
of these assumptions, procedures, and estimates win oe aeb^-r 
of their repeated use. 

^Uj:tce education was '^^^J/^rf.^lir./elr'r.^r/Jo; 

of credits accrued in 'Jf, P':"'";^^ ",5„f,?';jj „as assunted to be $3000. 
The average annual per P"? !"^'"'/;?"'^ outside of their regular 
r.lnJllS'e)^5n^::L3'?r^hrrnr-i;a?r:f*°tl!e1r standard wage, a co^on 

Tnio^rz r.ours/da, 

$21 500/year and calculated as follows, j^^i.ouu * j-o" j 
I t^^^ t1.e was calculated on {Je^^^fSSj^J^l^^^f S^J^J^^ 1^ 

OTWHOTc^^ other support for 

ihls position provided by '•'^4 »S°uLt!orwas"est1a,ated at $54 per credit 

cover all the "Sts of a course. ^^^^.^ 

The average salary ;;„^rjf f J^/, 'fj^edu e was estimated to be'$57 per 
courses and -"oving P the saUry sc e^^^ ^^^^ contained in Colorado 

Tn'n. ?■ irt-- -'-T'-^-'"^ --"^ ^^^^r^' Information, 1983. 
pu bU hed by the tolo'dllo Education Associa tion. Ihe average was 



1. 



2. 



3. 
4. 



5. 



6. 



7. 



8. 
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Obtained b, using the dat, 1"™ 5^»„,l^}^i.f rtie'?:MoJ'.So '^^tm.). 

of $3,35. . . ,Q /: etudents oer teacher in a given 

:res!'"pfHSra;'?rporte5^5;°tSe1olJrl^i^ra??:ent%f Education SUtus 

yl^.n"a ll«-perlo dTy'"*and the data In 110 above, the number of students 

^F!^^.:^^:^^^'^^^ . be . 
semester credit hours per semester. 

A third table. A.3. P-v1des Information on J^J^^j^^'lrJescHbe: the 
estl»,ate the cost of "^^^^T^//' ? ™ft fd at o at the local, , 
^?^„d%e tr^r^efel to ™ m ihe?rreco«n More detail is 

n' P a aior "not^s which follow the table. 



9. 

10. 

11. 
12. 
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Table A.l 

Costs of Single Interventions by Cost Category* 
(Dollars per Science Student per Class per year) 



Intervention 



SU 



Cost Category 



EOC 



Total 



A. Object 
1. Inc 
a. 

b. 



c. 
c. 
d. 
e. 



f. 



9" 



ve #1: Quantity 
•easing Student Requirements 
ncreasing graduation requirements 
n science for all students 
ncreasing college admission 
requirements in science for all 
ncoming freshmen 
ncreasing the length of the 
,chool year by 4 weeks 
ncreasing the length of the 
,chool day by one period 
ncreasing the amount of homework 
ssigned to students 
ncreasing proportion of total 
lass time devoted to instruction 
ncreasing proportion of scheduled 
.chool days actually devoted to 
lasses 

ncreasing academic requirements 
grades) for student participation 
II athletics 



130.02 



30.02 
333.40 
500.00 
• 1.59 



1.59 



$600.00 J630.00 



600.00 630.00 
$536.00 ,869.40 
401.99 901.99 
100.50 102.09 
1.59 



60.00 60.00 



301.50 ' 301.50 



*For definitions of cost categories, see Table I on page 30. 
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Table A.l (continued) 



Cost Category 



Intervention 



SU F T EOC P Total 



B. Objective 12: Quality 

1. Preservice Preparation of Teachers 

a. New standards for teacher prepara- 
tion programs 52.88 

b. Greater science requirements for 
elementary school teachers 1.15 

c. Specialized preparation programs 

for science teachers in grades 4-5 2.88 

d. More courses emphasizing the 
applications of science 1.15 

e. More "hands-on" work as part of 

teacher education programs 1.85 

f. Placing student teachers only 

with outstanding teachers 0.18 

g. Stronger enforcement of the 
requirements that school districts 
hire only fully credentialed 
teachers 

h. Loans or scholarships for persons 
preparing to be science teachers 

2. Enhancing Teaching as a Career 

a. Increasing salary of teachers 

within all fields 161.29 

b. Increasing salaries of teachers 
in science to be competitive with 
alternative employment 13.06 



$8.96 $11.84 

3.58 4.73 

8.95 11.84 

$0.05 3.58 4.78 

0.24 2.10 

0.30 0.48 

m 

11.39 ■ 11'39 



161.29 
13.06 
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Table A.l (contifiued) 



Cost Category 



Intervention 



S &L 



EOC 



Total 



2. Enhancing Teaching as a Career 
(continued) 

c. Establish performance pay for 
teachers 

d. Providing an improved professional 
environment within school districts 

e. Initiating cairf aigns to enhance ' 
local teacher recognition and 
respect 

f. Improving teacher recruitment and 
placement services 

g. Involving teachers with researchers 
in collaborative educational 
research 

h. Hore emphasis on professional 
growth, including better super- 
vision and evaluation of teachers 

• i. Reduce workloads (i.e., fewer 
students/class + fewer classes/ 
teacher) 

3. Improving Instructional Practices 

a. Improved teacher-student ratio 

b. Mastery learning 

c. Computer-assisted instruction 



J5.36 



0.08 
0.09 

5.35 

5.36 

240.00 



240.00 
1.82 



$0.27 



$5.36 
N/A 

0.08 
0.09 

5.35 

5.36 

240.00 



240,00 
2.09 

m 




4. Inservice Education of Teachers j2.66 

a. Summer institutes for teachers U.b3 U.uq lu.uy 

b. Academic year, fuU-tiffle institute 51^24 
for science teachers I2.<?b ji.^y '.^^ 

c. "Institute classes" conducted in 

late afternoon or evening during n n 97 2 45 

school year 1-53 0-65 i^-^' 

d. Inservice education on the 2 09 
applications of science 1.82 ^-^^ 

e. Inservice education classes focused 2 09 S 
on more advanced levels of science 1.82 u.^!/ 

f. Inservice education classes o" ... 2 09 
teaching methods u.^/ 

g. Inservice education program 

coordinated with local development ^ 2.09 

endeavors If 2J8 

h. Teacher centers ^-^^ 

i. Extended year contracts for program ^^^2 
development 3^59 

j. Improved teacher evaluation 3.58 ^^'^2 

k. Sabbatical leaves 23,12 

5. Improving Science Haterials, 5^0 
Equipment and Facilities ^-^^ 
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lable A.l (continued) 



Cost Category 



Intervention 



S&L F T EOC I Total 



6. Industrial Assistance 

a. Providing seed money for 

educational projects ^ • ^ • J 

b. Providing cash awards 0.72 . y 

c. Equipment donations by industry 0.72 i.u/ i-'^ 

d. Business/industry loaning 

lectures/workshop leaders to . i oo 

schools 0.49 0-73 1'22 

e. Rotating business and industrial - ^ 
employees to classroom teaching 30.46 45./0 /b.ib g 

f. Assistance in evaluating and 

developing curriculum 0.12 iJ'i^ ^'^^ 

g. Providing industrial internships 
for the employment of; teachers 
during summer 



4.94 7.40 12.34 



C. Objective 13: Appropriateness 
'1. Improving the School Curriculum^ 

a. Developing more courses showing 
,the applications of science for 

' personal needs and addressing . 
societal issues (local) ' $0.59 ■ • 

a: Same as C.a. except federal 0.05 ^'^^ 

b. Developing more rigorous science 
courses for college-bound students ^ 



(local) 

b: Same as C.b. except federal 
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Table A.l (contipued) 



Cost Category 



Intervention 



SU F T EOC P Total 



1. Improving the School Curriculum 
(continued) 

c. Reducing the number of "frill' 
courses 



N/A 



d. Federal funding of new curriculum 

development projects JO-O^ 

e. Revising the "old" NSF curricula 
by expanding them or replacing 

portions with locally developed ^ 
material ^'^•-^ 

f. Developing model curriculum 
patterns for districts 

g. Providing training for local 

school districts on how to develop ^ 
and implement curricula 0-03 

h. Establishing regional consortia 

of schools and universities to ^ 

develop curricula 0-30 
1. States (or groups of states) 

setting new standards for adopting . 

texts 0'^^ 
j, Developing model curriculum q 

patterns for districts to consider 0.05 ^'^^ 
k. Improving program evaluation 0.03 

146 147 



H 



ERIC 



lable A.l (tontinued) 



Cost Category 



c M F T EOC P Total 
Intervention S U F i 



0. Objective 14: Facilitation 

1. Improving Local Leadership 

a. Increasing the number of science 

supervisors within local school dn 
districts 12.40 

b. Weighting program development and 
implementation more heavily in the 

job descriptions of local school q^^q 
district science supervisors 0.60 

c. Weighting science program develop- w 
ment and implementation more 

heavily in the job descriptions q 
of general curriculum personnel 0.60 

d. State or federal funding of local 
district plans for providing 

greater leadership in science 3^5q 
education ^-^^ 

e. Training for school board members q q5 
with respect to science education 0.05 

2. Testing Programs 

a. Conducting awareness conferences 
and training sessions in test 

preparation for district testing q^q^ 
personnel ^'^^ 

b. Developing banks of test items and 

making them available to local ^^02 
district personnel ^-^^ . 



Table A.l (continued) 




Cost Category 



Interventiofi 



EOC 



Total 



2. Testing Programs (continued) 

c. Holding an awareness conference 
for publishers of tests used in 
district-wide testing programs 

d. Informing established citizen 
accountability committees in local 
school districts of the nce^i for 
improved testing 

3. Public Education 

a. Various forms of media advertising 
to promote more science 

b. Science television programs for 
the public 

c. Adult education courses for the 
public on science and technology 
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Calcylation of Costs for Single Interventions 



Cost 

Intervention Category 



EOC 



A.b. 



A.c. 



A.c' 



ill 
EOC 

p 

s u 



Explanation of Cost Calculations 



Based on interviews with school district administrators in two suburban Denver 
districts in which classrooms recently had been remodeled as science la ora- 
tories the cost of such remodeling and purchase of equipment is estimated to e 
$33,500. This cost is prorated over a 10-year period. The room is estimate to 
be used 6 periods per day for average-sized classes of 18.6 students: $33,500 i 
10 years i (18.6 x 6 students) = $30.02/student/year. 

The educational opportunity cost to the student is the value of f her «e 
the student would no longer be able to take. It is valued at cost: $3000/ 
student/year f 5 courses/year = $600/student/year. 

Same as A.a. above. 
Same as A.a. above. 

$3000/student/year i 180 days x 20 days = $333.40/student/4 weeks. 

Value of student time required for a longer school year and thus lost^froffl 
possible suwr employment: $3.35/hour x 8-hour/workday x 20 days = $536.00. 

Lengthening the school day by one class. Assume student now has 6 classes and 
then will have/: $3000 1 6 = $500/student/year. 

Value of student time required for a longer school day based on an increased 
h f I h ur in clas plus an additional 1/3 hour for homework._ Assume 
ItKe is valued at 1/2 of what it could earn, i.e., 1/2 of minimum wage: 
1 1/3 hours/day X 180 days x (3.35 f 2) = $401.99. 
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Table A. 2 (continued) 



Cost 

ention Category Explanation of Cost Calculations 



S & L The cost of inservice education for teachers is assumed to be that of n-cost 
tuition for continuing education classes. It is prorated over a "usefu life of 
5 years: 2 credit hours x $54/credit hours + 112 students t 5 years = SO, 19/ 
student/year. 

Teacher time for the inservice education is valued at its cost to the school 
district based on 180 eight-hour days for a year's salary ($21,500 180 days t 
8 hours/day = $H.93/bour): 2 credit hours x 15 hours/credit x $14.93/hour t 
112 students i 5 years = $0,80/student/year. 

Additional district supervision and help (1 day) based upon $48,000 for salary, 
benefits, support staff, and services: $48,000 t 180 days i 112 students 
i 5 years = $0,60/student/year. 

Total S & L: $0.19 + $0.80 + $0.60 = $1.59. 

P Assume an additional 20 minutes/day/student and that student time is valued at 

1/2 of minimum wage: ($3.35/hour t 2) x 1/3 hour/day x 180 days = $100.50/year. 

S & L Same as S & L for A.d. above. 

EGG Assume 2% of time valued at its cost of $3000 per student per year: 
.02 X $3000 = $60. 

EOC Assume student will expend additional effort required for eligibility and that 

this time amounts to 1 hour per day of work outside of class: 180 days x 1 hour/ 
day x ($3.35/hour i 2) = $301.50. 

S & L Based on an assumed increase of 1 semester. If tuition equals 25% of educational 
cost, then 75X is cost to state (tuition x 3, or $535 x 3 per semester): 
($535 X 3)/semester i 112 students i 5 years = $2.88. 
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Table A.Z (continuRd) 



,ntion Category Explanation of Cost Calculations 



S & L 



The cost of education at a state institution is estimated to be $5500/year for 
tuition, living expenses, etc.: $2750/ser,ester * 112 students/year t 5 years 
= $4.93. 

Lost earnings while attending additional semester of college: 4 months x 21 days 
X 8-hour/day x $3.35/hour * 112 students * 5 years = $4.03. 

Assume tuition is IS% of cost as in B.l.a. above and assuming that an additional 
6 semester hours are required: $1605 x 6 hours/15 hours t 112 students t 
5 years = $1.15. 

T Additional educational cost is for 6 semester hours. Use same assumptions as in 

B.l.a. above: $2750 x 6 hours/15 hours * 112 students * 5 years = $1.9/. 

Lost earnings are same as B.l.a. above multiplied by 6/15: $4.03 x 6/15 ,= $1.61. 

Total cost to teacher: $1.97 + $1.61 = $3.58. 
S & L Same as B.l.a. above. 
T Same as B.l.a. above. 

5 & L Assume 2 additional courses are required, then the analysis is the same as B.l.b. 
above. 

F Assume NSF-funded development of materials for this purpose at ^^^^^f^l^''' 

and there are 41,000,000 students in U.S. schools {K42): $10,000,000 i 
41,000,000 * 5 years = $0.05. 

T Same as B.l.b. above. 



fable A. 2 (continued) 



Cost 

vention Category Explanation of Cost Calculations 



SAL It is assumed that additional instructor time costing $30,000 per year will be 
needed equivalent to an instructor for a 3-credit-hour course: 
$30,000 + 5 courses/year + 20 students/course + 112 students + 5 years = $1.86. 

F Same as B.l.d. above. 

S & L Assume $100/student teacher for additional selection and supervision costs: 
$100 i 112 students/year i 5 years = $0.18. 

T Additional travel for student teacher: 10 miles x 15 weelcs x 5 days/week x 

$0.22/mile i 112 students + 5 years = $0.30. 

N/A 

F Assume cost of education (J3500/year x 4 years) is paid back over 10 years on an 

interest-free loan with the cost of interest for the government being 

Interest Cost: $22,000(1.09)^° - $22,000 = $30,081. $30,081/(1.09)^° = $12,707 
(amount to be set aside now to pay for the total interest). $12,707 * 112 
students per term + 10 years = $11.39. 

S & L Assume increase of $3000/year: $3000 i 18.6 students = $161.29. 

S & L Assume 8.U of teachers are science teachers and that salaries for them will be 
increased $3000/year: $3000 i 18.6 students x .081 = $13.06. 
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Table ^.?. (cnnliriued) 



Cost , , 

entlon Category Explanation of Cost Calculations 



S & L Assume additional supervision of 1 supervisor at 1/4-tiiTie teachers: 
$48,000 i 80 i 112 students/teacher = $5.36. 

Inservice education for supervisor assuming average number of students/school is 
664: 2 credit hours x $54/credit hour t 664 t 5 years = $0.03. 

Cost of supervisor time to attend inservice: 2 credit hours x 15 hours/credit 
hour X $21/hour i 664 students i 5 years = $0.19. 

Total S I L cost: $5.36 + $0.03 + $0.19 = $5.58. 



N/A 

Shi For management of the process, assume 1 month time for 1000 teachers and 
miscellaneous expenses of $5000: $48,000 t 12 i 1000 * 112 = $0.04. 
$5000 i 1000 i 112 = $0.04. Total S & L: $0.04 + $0.04 = $0.08. 

S & L Assume $1000 per person hired and that 10^ of staff are hired»each year. This 
intervention would apply to all teachers: ($1000 x 10^/year) i 10 years t 
112 students = $0.09. 

S & L 40 hours/year x $14.93/hour t 112 students = $5.35. 
S & L Same as B.2.C. above. 
S & L Same as B.3.a. below. 
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l()l)ln (cDfii IiiiumI) 



Cost 

ufiliofi Cdtdinry Explcinol ion of Cost. Calculations 



N/A 



S h L Ki'diiu.' workloiid by lOX. Since must costs, such as toachor salarins and 

facilities aro a function of class si/e, assuiiio that H{}% of costs aro applicable 
and are directly proportional: $3000 x 0.80 x 0.10 = 12^0. 

\j [. Inservice education is priced at cost, Insorvice education at the rate of 

•Mull-cost" tuition for a continuing education class (3 seniester-hours-credit) : 
(3 X $50) I 112 students i b years - 10. ?9. 

Increased salary froni upward movement on salary schedule due to taking a credit 
course. It is a cost to the district and a benefit to the teacher: $57/sefiiester 
hours X 3 hours * 112 students = $1.53/year. 

Total S & L cost: $0.29 + $1.53 = $1.82. 

T Cost to teacher because of time expended: 3 semester hours x 45 hours/credit x 

($14.93/hour X 1/2) f 112 students f 5 years = $1.80. 



Net cost to teacher: $1.80 - $1.53 = $0.27. 



S & L Increased teacher salaries from receiving academic credit (see B.3.b. above): 
$1.53. 

F Cost of the institute based on $195/week: 3 weeks x $195/week f 112 students 

i b years = $1.04. 

T Cost: time lost - increased salary from participation. Cost of time lost: 

3 weeks x 40 hours x ($3.35 x 2) f 112 students f 5 years = $1.44. 

Net cost: $1.44 - $1.53 (see above) - -$0.09. ^ 
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Table A. 2 (continued) 



Cost 

sntion Category Explanation of Cost Calculations 

S & L Increased salary from aioving up on salary schedule assuming 24 semester hours of 
academic credii are earned: 24 semester hours x $57 r 112 students = $12.25. 

F Institute cost: $7000 f 112 students ^ 5 years = $12.54. 

Assume stipend for teachers of $300/week: $300 x 36 weeks r 112 students i 
5 years = $19.35,, 

T Lost salary = salary - stipend: ($21,500 - $10,800) ^ 112 students = $19.17. 

Net cost = lost salary * salary increase: $19.17 - $12.26 = $7.09. 
S & L Increased salary (see B.3.b. above): $1.53. 

F Cost of institute at $360 per semester class:' $360 f 112 students i 5 years 

= $0.65. 

T Increased salary - time lost = net cost. Time lost: 3 semester-hours x , 

45 hours/credit x ($14.93 ^ 2) ^ 112 students f 5 years = $1.80. 

Net cost: $1.80 - $1.53 = $0.27. 

S & L Cost of class at rate of "full-cost" tuition: ($54 x 3) t 112 students f 
5 years = $0.29. 

Total S & L cost: $0.29 + $L53 (see B.3.b. above) = $1.82. 
T See B.4,c. above. 



Table A. 2 (continued) 



Cost 

ention Category 



Explanation of Cost Calculations 



S «. L 



S «. L 
S & L 

F 



Same as B.A.d. above. 
Same as B.4.d. above. 
Same as B.A.d. above. 

San,e as B.4.d. plus an S ^ L amount for materials jnd supplies ($0.29) equal to 
the cost of the inservice education, giving a total of W.ia. 

1 nf tpl SOO olus benefits of 20% and a school year of 36 

Assume an annual salary of ^^l.^^uu p us oenei $717/weel< i 

weeks. The intervention is assumed to be an extension or i ween. 
112 students = $6.42. 

Same as B.2.C. 

= $2 80. Total: $2.50 + $2.80 = $5.30. 



Same as B.6.a. above. 
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Table A. 2 {continued) 



Cost 

Intervention Category Explanation of Cost Calculations 



.b.e, 



B.6.C. Same as B.6.a. above. 

e e.d. F For reasons given in B.6.a. above, this amount 'is W of the total calculated 

in Cost Category I below: m of $1.22 = $0.49. 

I Assume 1 day of a professional whose salary is $30,000 and who works 220 days/ 
year. This time benefits 112 students: $30,000 i 220 days i 112 students 
$1.22. 6031 of $1.22 = $0.73. 

F The difference between a teacher's salary and an industrial employee's salary is 
borne by industry: ($30,000 - $21,500) i 112 students = $76.16. Because of 
tax benefits, 40X is borne by the federal government: $76.16 x 0.40 = $30.46. 

I $76.16 X 0.60 = $45.70. 

B 6 f F Assume 1 week of industrial employee's time benefits 2000 students; $30,000 i 

50 t 2000 = $0.30,; Because of tax benefits, 40X is borne by the federal 
government: 0.40 x $0.30 = $0.12. 

I 0.60 X $0.30 = $0.18. 

B 6 q F Because of t^x benefits, the federal cost is m of the figure calculated under 

Cost Category I below: 0.40 x $12.34 = $4.94. . 

I Assume that because of the short-term nature of the employment, their value to 
the employer is hi of their teaching salary. Thus contribution is 2531: 
($21,500 X 10 weeks/39 weeks x 0.25) i 112 = $12.34. 0.60 x $12.34 = $7.40. 
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Table U (contioyed) 



Cost 

Intervention Category 



Explanation of Cost Calculations 



C.a, 



C.a.' 



C.b. 
C.c. 

C.d. 
C.e. 

e.g. 



C.h. 
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local curriculum development is based on an assumption of an 80,000-student 

iTstrJct (only a large one probably is prepared to f ocate t « 
required) and a course for 6000 students developed at a c st of 0 which has 
a life expectancy of 1 years: 125,000 i 6000 students f 1 years = J0.59. 

Federal curriculum development is based on an estimate of 12,000,000 to develop 
Ito^Jse potentially usable by all students in the U.S. at a given grade level 
and having a life expectancy of 7 years. 

Same as C.a. and C.a.' above. 

Same as A. a. above.. 

Same as C.a: above. ... 

This cost is assumed to be 1/2 of the cost of a m locally developed course. 
Thus the cost is 1/2 of that calculated as an S ^ L cost in C.a. above. 

It is assumed that training will be provided for one leader from each of 181 

h 1 IhJricts with the exception of the largest 20 which would have an average 
of 3 each, giving a total of 221. The scope of training is assumed to be 
equivalent o six semester hours of course work and, is estimate to cos 5 , 
giving a total of approximately J72,000. It is prorated over all students in one 
state (Colorado) and assumed to have a useful life of 5 years: 
y2,000 i 545,000 students i 5 years = $0.03. 

Assume that lower unit cost obtained by several districts working together is _ 
ll balrced by the cost of greater quality sought through a more.xpensive 
velopment cost. If total cost is doubled but it is sprea among 4 1 m es 
S students, the unit cost will be. 1/2 that described in C.a. above for loci 
curriculum development: $0.59 x 1/2 = $0.30. 
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Table A. 2 (continued) 



Cost o , •. ^. 

intervention Category Explanation of Cost Calculations 



r i S U Assume a cost of U00,000 for developing new standards and that they apply to 

2,000,000 students: $100,000 i 2,000,000 students = $0.05. 

r i ni Sioiilar to c.i. above, if done at the federal level, the costs could be somewhat 

lower per student but this reduction probably would be counterbalanced substan- 
tially by attempts to do higher quality development work. 

C k S U Assume $4000 for an every-5-yeflr external audit of district with 25,000 students: 

$4000 i 25,000 i 5 years = $0.03. 

n 1 , s u Assume 1 supervisor per 20,000 students now at a cost of $48,000 for salary, 

benefits, support staff, and services. Assume also that supervision is increased ^ 
to 2 supervisors for 20,000 students: $48,000 f 20,000 = $2.40. n 

. s h L Assume an additional of time devoted to this function in a situation where 
there is 1 supervisor per 20.000 students: $48,000 f 20,000 students x 0.25 
= ^0.60. 



O.l.b. 



Oj.c. s h L Same as D.l.b. above. 

11^^ S a Estimated to be $3.50 per student. 

nip- s u Each of five regional meetings is expected to cost $2500 including travel 

expenses, honoraria for workshop leaders and materials. Costs of ravel for 
narticipants is estimated at $10 per person (carpooling is assumed) for a total 
of 900 school board members. The addition of a lunch for each participant gives 
a total cost of $25,900: $25,900 f 545,000 students = $0.05. 
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Table U (continued) 



Cost 

Intervention Category 



0.2. a. 



D.2.b. 



D.2.C. 



0.2.d. 



Explanation of Cost Calculations 



S u It is assumed that there are 20 districts with testing personnel on their staff 
nd representing 50^ of the students in an average-s.ed s a e Co ora ). The 
cost of the awareness conference is estimated at M: $2900 * 272,000 
students = $0.01. 

u I The cost of developing items for an item bank is estimated to be $100/item for 
' ^ ' m Hems for a toLl cost of $50,000. Assume that the items are available for 

use by all students in the state and they have a useful life of b yearo. 

$50,000 T 545,000 students r 5 years = $0.02. 

F Assume a cost of $12,000 and a beneficial effect for all students in the nation: 
$12,000 T 41,000,000 < $0.01. 

The cost of printing and distributing materials to 2900 committee members at $2 
llZ 0 0 for eveloping the materials is $7800. The cost of a con ere 
fSr this same people is estimated to be $20,000. The total cost is $27,800 and 
is assumed to benefit all students in the state: 
$27,800 T 545,000 students = $0.05. 



A per pupil cost analysis for these three interventions has not been conducted. 
SoiTcostTnformation is provided, however, as follows. 

A 30.second public service announcement is estimated to cost $3600 to prepare 
exclusive of the cost of broadcast time. 

The cost of science television programs are estimated to be $400,000 per 
30-minute program. 

Adult education classes are estimated to cost $54/semester hour for each 
participant. 
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Table A. 3 

Calculation of Increase in Average Annual Per Pupil Cost 
of Education to Initiate Project Recommendations 
(Dollars/Pupil/Year) 



Intervention 



Cost per Science 
Student per 
Class per Year 



Increase in Average Annual Per 
Pupil Cost of Education 



Local 



State 



Federal 



State Actions 

Assistance to local 

districts 
B. I.e. 

■ g- 

,h. 



C.l. 

C. 1. 
c.l. i . 
O.l.e. 

D. 2. 
D.2. 
D.2. 



, a. 
,b. 
d. 



State leadership 

Local Actions 
A.l.a. 
A.l.d. 

A. I.e. 

B. 2.d. 
B.2.f. 
B.2.g. 
B.2.i. 
B.3.b. 

Inservice education 

B. 5. 

C. l.h. 
C.l.k. 
0.1. a. 

Selection of 
principal s 

Federal Actions 

B. 4.C. 

C. l. a: 

C. l.h. 
Research 

D. 2.C. 

Funding of state 
programs 



$1.86 
0.03 



30 
05 
05 
,01 
,02 
.05 



30.02 
1.59 
1.59 
N/A 
0.08 
0.09 
2.91 
1.82 

5.30 
0.30 
0.03 
2.40 



.0.65 
0.59 
0.30 

0.01 



(Totals) 



$1.15 (e) 
0.13 (f) 
0.13 (f) 
0.22 (g) 
0.08 
0.09 

0.25 (h) 
0.15 (i) 

(j) 

0.43 (k) 
0.04 (1) 
0.03 
0.60 (m) 

0.07 (n) 



$0.23 (a) 
0.15 (b) 
.03 

.04 (c) 
.05 
.05 
.01 
0.02 
0.05 

0.18 (d) 



0. 
0. 
0. 
0. 
0. 



(0) 



$3.37 



S0.81 



$0.65 
0.24 
0.08 (p) 
0.29 (q) 
0.01 

0.20 

$1.47 
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Explanatory Notes for. Table A, 3 



a. Based on an estimate of a $125,000/year program: $125,000 * 545,000 
students = $0.23. 

b. Based on 8.1% of teachers being science teachers: $1.86 x .081 = SO. 15. 

c. Costs are allocated to 80,000 students rather than the original 6,000. 

d. Based on an estimate of $100,000 to provide state leadership: 
$100,000 f 545 students = $0.18. 

e. Based on an estimate that this increase will offset 1/2 of all graduating 
seniors each year: $30.02 * 13 grades x 1/2 = $1.15. 

f. This intervention is science teachers who constitute 8.1% of the teachers 
$1.59 X .081 = $0.13. 

g. Based on an estimated cost of $100 per science teacher and an estimate of 
230 students per science teacher (18.6 stud'en'tsp/teacher * .081 science 
teachers/teachers) and 1/2 of the students in a district being secondary 
students: $100 f 230 x 1/2 = $0.22. 

h. Based on an estimate of 8.1% of teachers being science teachers: 
$2.91 X .081 = $0.25. 

i. Based on an estimate of 8.1% of teachers being science teachers: 
$1.82 X .081 = $0.15. 

j. Included in the cost of other interventions. 

k. Based on an estimate of 8.1% of classes (teachers) being science teachers 

$5.30 X .081 = $0.43. 
1. Same as "c" above. Local support of curriculum development is needed as 

well as the state support, 
m. Some costs of supervision, mostly building level, are included in other 

local interventions. Some additional central district supervision is 

included here--25% time for one person for each 20,000 students: 

$2.40 X .25 = $0.60. 
n. It is estimated that one principal will be recruited for each 7,000 

students each year at an increased cost of $500: • 

$500 ♦ 7000 students = $0.07. 
0. Based on an estimated five curriculum projects operating at a given time 

at $2,000,000 per year: $2,000,000 x 5 * 41,000,000 students = $0.24. 
p. Support of local curriculum level is assumed at a cost equal to the total 

of the local and federal shares listed above, 
q. Based on an estimate of $12,000,000 per year: 

$12,000,000 * 41,000,000 students = $0.29. 
r. Federal support of state programs, and indirectly local programs, of 

science education improvement is estimated at $8,000,000 per year. It is 

assumed that this- support will supplement not supplant the activities 

specifically listed as state or local actions: 

$8,000,000 * 41,000,000 students = $0.20. 
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